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To my Students 
Past^ presenty and future 




Foreword 


The staff of the Department of Electrical Engineering at the Massa¬ 
chusetts Institute of Technology some twenty years ago undertook an 
extensive program of revision as a unit of its entire presentation of the 
basic technological principles of electrical engineering. By early 1943 
this collaborative enterprise had resulted in the publication of three 
volumes of a projected series. Publication of this complementary book 
of the series was delayed by the war. 

The decision to undertake so comprehensive a plan rather than to add 
here and patch there came from the belief that the Department’s large 
staff, with its varied interests in teaching and related research, could 
effect a new synthesis of educational material in the field of electrical 
engineering and evolve a set of textbooks with a breadth of view not 
easily approached by an author w-orking individually. 

Such a comprehensive scries, it was felt, should be free from the dupli¬ 
cations, repetitions, and imbalances so often present in unintegrated 
series of textbooks. It should possess a unity and a breadth arising from 
the organization of a subject as a whole. It should be useful to the student 
of ordinary preparation and also provide a depth and rigor challenging 
to the exceptional student and acceptable to the advanced scholar. It 
should comprise a basic course adequate for all students of electrical 
engineering regardless of their ultimate specialty. Restricted to material 
which is of fundamental importance to all branches of electrical engineer¬ 
ing, the course should lead naturally into any one branch. 

Such a basic synthesis, it is felt, has been appropriately achieved in the 
first three volumes. In the course of their generation it })ecame more and 
more evident that the development of further extensions of this basic 
material covering specialized fields would correspondingly become more 
and more the responsibility of individual authorities who could relate 
their work to the basic structure. 

The four volumes and the organized program of teaching out of which 
they have grown, are thus the products of a major research project 
to improve methods of technological education. The experience gained 
through the years in this stimulating exploration, together with the 
rich background of accelerated development contributed by the circum¬ 
stances of war, opens the way for further evolution in this undertaking. 
Perhaps the most interesting potentialities lie in the influence of the social 
sciences and humanities on the extensions of this vital adventure. 


J. R. Killian, Jr. 




Preface 


When the writing of basic text material for the undergraduate curricu¬ 
lum was first undertaken by the Staff of the Department of Electrical 
Engineering we felt that this material should not merely fill the immediate 
needs of the undergraduate subjects for which it was primarily intended 
but in addition should offer stimulation and incentive for further study. 
For this reason occasional glimpses were afforded of the horizons which 
lie beyond the artificial boundaries set by conventional limitations in the 
treatment of technological principles. The collateral discussions engen¬ 
dered by these aims tended to appear digressive; moreover, they became 
so numerous as to interfere seriously with conciseness, continuity, and 
clarity. We therefore determined to relegate these supplemental treat¬ 
ments to an appendix. As the project developed the appendix became 
too large to justify itself; in fact, it took on the aspect of a text in itself. 
Thus evolved the concept of companion or reference volumes for collateral 
study. 

Later, when we evaluated this concept as to scope and organization, 
we concluded that the supplemental material would be more useful if the 
discussions of a purely mathematical nature were collated and separated 
from the applications to be predicated thereon. This book is the result 
of this effort to avoid redundance and to attain a logical unification. The 
applications themselves, then, were to appear as further reference volumes 
of the series depending for their foundations on The Mathematics of 
Circuit Analysis, 

In the course of these efforts war intervened. Through its exigencies 
there was an unprecedented acceleration of scientific and technological 
effort, compressing into a few years what normally would have taken 
decades to achieve. Necessarily the revision program was held in abeyance 
during this critical period with the result that the Department of 
Electrical Engineering is now reconsidering the course revision program 
and modifying its prewar plans. The basic series must be reappraised in 
the light of the vast wartime developments. This may well lead to the 
addition of material to the earlier basic texts. Moreover, there must be 
drastic reconsiderations of the supplemental volumes which will form 
extensions of the basic series and complement this particular reference 
volume. Since at the moment this book goes to press the Department is 
in the midst of reevaluating the extensive revision program, it is impos¬ 
sible here to make precise pronouncements either as to the character or 

vii 
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number of volumes to follow. Although thus far it has been the practice 
to {)uhlish the volumes of the series without naming collaborators, since 
the immediate volume came aVxmt largely through the inspiration of 
Professor (kiillemin, and since it was written entirely by him under the 
trying pressures of war, it has been decided to recognize him as author. 

As to the subject of this volume it may be well to emphasize that a 
mathematical textbook written by engineers is to be looked upon as an 
idea conveyor without claim to rigor. The discussions given herein should 
be regarded as l)eing plausibility arguments rather than proofs. The 
primary purpose is to stimulate interest and lay a background of general 
understanding upon which the student may later build more carefully. 
In no wise therefore is the character of presentation here given to be 
looked upon as a substitute for the more formal rigorous treatment of 
the mathematician. 

Although other books of this nature have been written, in the planning 
of this book we felt that a rather complete assemblage of mathematical 
topics, ne^eded specifically or collaterally in the analysis and synthesis of 
electrical networks and in the attack on field problems related to trans¬ 
mission lines, wave guides, and antennas, was still outstanding. The 
opportunity to include more detailed discussions of certain topics here¬ 
tofore given too little attention has been capitalized, we hope, to the 
advantage of student and researcher alike. 

In the field of advanced algebra, for example, we believed that a 
discussion of determinants and matrices becomes ever so much more 
meaningful when coupled wdth the geometrical interpretations provided 
by the subject of linear coordinate transformations and the closely 
related discussion of cjuadratic forms. Thus the first four chapters of 
this book bring together a collection of topics in advanced algebra that 
form a closely interrelated mathematical unit, and an indispensable unit 
in the foundations of circuit theory or any other field of application dealing 
with vibrations or particle dynamics. 

The fifth chapter, on vector analysis, is incorporated at this point 
since the geometrical and algebraic ideas involved are closely related to 
the foregoing material, and because the two-dimensional aspects of 
vector analysis and field theory are very heli)ful in lending physical 
clarity to numerous topics in complex function theory which is taken up 
next. Here there is considerably more detail than is to be found in exist¬ 
ing textbooks for engineers on this subject. While the usual book for 
the most part is content to lay a nominal background for the methods of 
comj>lex integration j^lus some notions about conformal transformations 
for field-mapping purposes, here it is our aim to provide a physical and 
geometrical feeling for the properties of complex functions adequate to 
meet diverse needs in the network synthesis field. The last two articles 
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in this chapter, for example, are specifically concerned with a detailed 
discussion of factors relevant to stability considerations and the properties 
of physical impedance functions. 

The final chapter, dealing with Fourier series and integrals, stresses 
a number of items with which the engineer is especially concerned such 
as the convergence of Fourier series, the approximation properties of its 
partial sums, singularity functions and their properties, elementary 
transform properties, evaluation of inverse transforms through complex 
integration, and their approximate evaluation through use of the saddle- 
point method. 

The Department of Electrical Engineering 

Cambridge, Massachusetts 

January, 1949 
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CHAPTER I 


Determinants 

1. Definitions and useful properties 

A discussion of the theory of determinants may be approached in a 
variety of ways. For the reader who already has an acquaintance with 
this subject and can, therefore, dispense with introductory remarks, the 
following procedure* is particularly effective since it strikes directly at 
those ideas which make the determinant a useful tool. 

A determinant is commonly written in the form 



Uii 

ai2 * 

* <^ln 

A = 

^21 

^22 * 

* ^2n 


^nl 

a„2 * ■ 

■ ' ^nn 


in which the vertical lines enclosing the array of elements aik are intended 
to take the place of parentheses as an indication that these elements are 
the variables of the function A, just ^sf{x) is written as a symbol for a 
function of x. 

The determinant is said to be of the ni\\ order when it involves n rows 
and n columns, the total number of elements then being ri^. The italic 
capital letter A is used as an abbreviation for the function whose elements 
are denoted by the lower case letter a. Thus, B may represent another 
determinant with the elements bik, etc. The first index on an element 
indicates the row, the second index the column in which that element is 
situated. 

The determinant may be defined unicpiely in terms of the following 
three fundamental properties: 

I. The value of the function is michanged if the elements of any row 
{column) are replaced by the sums of the elements of that row 
{column) and the correspo'nding ones of another row {column); 
for example, if an, ai 2 , * • • are replaced by (an + aai), 

(ai2 + a32), * • • (ain + aan). 

II, The value of the function is multiplied by the constant k if all the 
elements of any row or column are multiplied by k. 

III. The value of the function is unity if all the elements on the principal 
diagonal, that is, an, a 22 , ' * • ann, unity and all others are zero. 

Caratheodory, Vorlesungen uber rcclle Funktionen (Leipzig, 1918), Ch. VI. 

/ 
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To these three fundamental properties may be added the following 
derived ones: 

IV. The first fundamental property may he amplified to the effect that 
an arbitrary factor times the elements of any row or column may he 
added to {or subtracted from) the corresponding elements of another 
row or column. 

V. The algebraic sign of the function is reversed when any kvo rows or 
columns are interchanged. 

VI. The value of the function i\ zero if all the elements of a row or column 
are zero, or if the corresponding elements of any two rows or columns 
are identical or have a common ratio. 


Rule I V may be seen to follow from I and II. As shown in the numerical 
example below, the elements of the third column are first multiplied by k\ 
the resulting A;-multiplied elements are then added to the respective ones 
of the first column, after which column three is multiplied by k~^^, thus 
restoring to its elements their original Vtilues. 


1 3 2 


1 3 2k 


(1 + 2k) 3 2k 

4 2 6 

kA = 

4 2 6/!: 

— 

(4 + 6/fe) 2 (ik 

3 1 7 


3 1 n 


(3 + n) 1 Ik 


A = 


(1 4- 2k) 3 
(4 + (>k) 2 
(3 + Ik) 1 


[ 2 ] 


Rule V is a consequence of I and the extended form IV of II. Thus, 
suppose column 1 is first added to column 3, next the resultant column 3 
is subtracted from column 1, and, finally, this resulting first column is 
added to the resultant column 3. The net effect is to interchange columns 1 
and 3 and prefix all the elements of the first column with minus signs, 
as illustrated below: 



1 3 2 


1 3 (2 + 1) 

A = 

4 2 6 


4 2 (6 + 4) 


3 1 7 


3 1 (7 + 3) 


-2 3 (2 + 1) 


-2 3 1 

-6 2 (6 + 4) 

= 

-6 2 4 

-7 1 (7 + 3) 


-7 1 3 


The first part of rule VI follows from the property II for ife = 0, and the 
second part is seen to be true on account of IV because a row or column 
of zeros is obtained when, for a suitably chosen factor, the ^-multiplied 
elements of one of the proportional rows or columns are subtracted from 
the respective elements of the other row or column. 
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2. Evaluation of numerical determinants 

The properties discussed above may be applied to the numerical 
evaluation of determinants, as is best illustrated by the following numeri¬ 
cal example. Let 

1 2 

^= 4 2 6 [4] 

3 1 7 

Step /. Subtract from the second row the 4-multiplied elements of the 
first row: 

1 3 2 

A= 0 -10 -2 [5] 

3 1 7 

Step 2. Subtract from the third row the 3-multiplied elements of the 
first row: 

1 3 2 

A 0 -10 -2 [6] 

0 -8 1 

Step 3. Subtract from the third row the ^^-multiplied elements of the 
second row: 

1 3 2 

A ^ 0 -10 -2 [7] 

0 0 

Step 4. Subtract from the second column the 3-multiplied elements of 
the first coliunn: 

1 0 2 

A= 0 -10 -2 [ 8 ] 

0 0 

Step 5. Subtract from the third column the 2-multiplied elements of 
the first column: 

1 0 0 

A = 0 -10 -2 [9] 

0 0 

Step 6. Subtract from the third column the ^%-multiplied elements of 
the second column: 

1 0 0 

i4 = 0 -10 0 

0 0 ^ 


[ 10 ] 
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Application of the fundaiiierital properties II and III then gives 

! 1 0 Ol 

A = (1)(-I0)m 0 1 0 U a)(-10)(Jga) = -26 [11] 

10 0 1 I 

It is useful to note that the modifications involved in the last three 
steps of this process do not influence the values of the elements on the 
principal diagonal, the product of which is equal to the value of the 
determinant. This fact may be stated in the form of an additional derived 
property: 


VII. The value of the special delertninanl in triangular form: 


A = 


flj] ai2 ni.3 • ■ • Uin 

0 ^22 ^23 • • • <32n 

0 0 a-M ■ ■ ■ a-jn 


0 0 0 • • • 


[ 12 ] 


is given hy the product (aiia 22 * * • of the elements on its 
principal diagonal. 

With the help of this rule the value of the determinant in the above 
example may be set down after the completion of the third step. 

If in the determinant A the rows and columns are interchanged, the 
values of the elements on the principal diagonal are not affected; and if 
the above operations with respect to rows are then replaced by the same 
operations with respect to corresponding columns and vice versa, the 
same linal value is evidently arrived at. This fact demonstrates the 
equivalence of rows and columns as far as the value of a determinant is 
concerned. For convenience in reference this is stated as the property: 


VIII. The value of a determinant is unchanged if its rows are written 
as correspofiding columns or vice versa. 

In numerical work, the method of evaluation illustrated in the above 
example is short and convenient to apply. When an analytic result is 
desired, however, other methods are usually prefe'*able. They are given in 
Arts. 4 and 5, to which the discussion immediately following serves as an 
introduction. 


3. Minors and cofactors 

If in the determinant A of Eq. 1, one or more rows and a corresponding 
number of columns are deleted, the remaining square array of elements is 
again a determinant. It is referred to as the (« — />)-rowed minor (or 
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minor determinant) of where the integer p denotes the number of rows 
or the corresponding number of columns which have been deleted. Thus 
the j^-rowed minor is the determinant itself. An {n — l)-rowed minor is 
also spoken of as a first minor, an {n — 2)-rowed one as a second minor, 
etc.* 

The minor is customarily denoted by a symbol whose indexes refer to 
the canceled rows and columns. Thus the minor Mik is formed by cancel¬ 
ing the fth row and the ^th column in A. It is quite common to speak of 
Mik as the minor of or as the minor corresponding to the element 
although (according to the immediately following discussion) it should 
more properly be referred to as the complement of Oik. 

A minor of second order, denoted by Mik, is formed by canceling the 

f.V 

fth and rth rows and the A’th and ^th columns. I'hc extension of this 
notation to the designation of minors of higher order is readily recognized, 
but when the number of canceled rows and columns is large (cases of this 
sort are infrequent in engineering applications), such notation becomes 
awkward and is usually replaced by some other expedient which seems 
more effective at the moment. 

The elements wdiich lie at the intersections of the canceled rows and 
columns, arranged in a square array in the same order (from left to right 
and from top to bottom ) as they appear in the original determinant, form 
another minor determinant N which is called the complement of M, Ihe 
complement of a first minor is a single element; that of a second minor is 
a two-rowed determinant, etc. 

In particular, the minors formed by canceling the same rows as columns 
(these intersect on the principal diagonal) are called principal minors, and 
their complements are again principal minors. 

An alternative view may be taken with regard to the formation of 
minors. Instead of obtaining the minors by canceling rows and columns 
in the original determinant, they may be formed l)y first selecting from the 
determinant certain rows, and subsequently selecting from this rectangu¬ 
lar (nonsquare) array any like number of columns. Or, from a given set 
of columns in the determinant A, minors may be formed by the selection 
of corresponding numbers of row^s. The minors thus formed are evidently 
the complements of those obtained by the process of canceling the same 
combinations of rows and columns. 

If M is a minor of the determinant A and N is its complement, and if 
the rows and columns contained in M are formed from the i, j, • th 
rows apd the r, 5, • • • th columns of A , then 


*The terms “minor of first order,” “second order,” etc., arc also used. 
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is referred to as the algebraic complement of M. This differs from the 
ordinaiy complement only in its algebraic sign. If the sum of the indexes 
referring to the (first, second, etc.) rows and columns of A contained in M 
is an even integer, the algebraic sign, by Eq. 13, is +1; if this sum is an 
odd integer, the sign is — 1 . 

The relation between a minor and its complement is evidently a mutual 
one in the sense that the two designations may be interchanged. Whereas 
M may be called a minor and N its complement, N may be looked upon 
as the minor and M as its complement. Thus, a single element may be 
thought of as a one-rowed minor. If the element is a,*, its complement is 
the minor 

The algebraic complement of the single element a,t is suflSciently 
important to deserve a special name and symbol. It is called the cofactor 
of a,fc and is quite commonly denoted by the corresponding upper-case 
letter with like subscripts (although various other notations are also 
encountered in the literature). Thus, the cofactor of Oj* is given by 

Aa = [14] 


It differs from the minor (which is the complement of o,*) only in algebraic 
sign; hence the cofactor is sometimes referred to as the signed minor. 

The indexes i and k, whose integer values determine the sign-controlling 
factor (—1 )*■'■*', refer respectively to the row and column intersecting at 
the point where the element a,* is located. If the cofactor is formed for an 
element in the original determinant, its indexes and those appearing in 
the sign-controlling factor obviously agree with the indexes appearing 
on the element in question, because the indexes on an element of the 
original determinant indicate respectively its row and its coliunn positions. 
This correspondence is, however, no longer consistently true in a minor 
of the original determinant. 

For example, the minor M 23 of A, Eq. 1 , reads 


ail 

ai2 

014 

<^16 • 

■ • Oln 

^31 

032 

^34 

036 • ' 

CO 

041 

O42 

O44 

O45 • ■ 

• 04„ 

^nl 

On2 

On 4 


’ * ^nn 


[15] 


Here the element O 32 , for instance, is located at the intersection of the 
second row and the second column. This is referred to as the (2,2) position 
in the minor determinant of Eq. 15. In general, the term (r,^) position is 
used to indicate the location at which the rth row and sth coliimn of a 
given rectangular array intersect. The object of the present argument is 
to point out as a typical case that in forming the cofactor for the element 
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032 for the minor determinant of Eq. 15, the sign-controlling factor is 
(—and not ( — 

If only the algebraic signs of the cofactors are set down at the positions 
of the corresponding elements in a rectangular array, the following 
checkerboeurd of -|- and — signs is obtained: 


+ - + -•• 

— -j- _ 

+ - + -•• 

- + - -f • • 


[16] 


This pictorial statement for the signs of the cofactors is sometimes referred 
to as the “checkerboard rule.” 


4. Laplace’s development 

In the manipulation of determinants, and sometimes to facilitate their 
numerical evaluation, a process of development formulated by Laplace 
is frequently useful. It may be stated in the following form: 

// all the minors are formed from a selected set of rows or columns of a 
determinant and the products of these minors with their respective al¬ 
gebraic complements are added, the resulting sum is equal to the deter¬ 
minant. 

If a single row is selected, this development reads 

A = anAii -h + • • • + OinAin (f = 1, 2, ’ ' • n) [17] 

For a single column, the result is written 

A = aikAik + 0’2kA2k + • • • + a,„kA„k (^ = 1, 2, • • • ») [18] 

In Eq. 17 the determinant is represented by the sum of the products of 
the elements of any row' with their respective cofactors. In Eq. 18 a 
corresponding summation is carried out with respect to the elements and 
cofactors of any column. This simplest form for the Laplace development, 
which is also called an expansion of the determinant along one of its rows 
or columns, is the one most frequently used. 

It may be of interest, however, to illustrate a more complicated example 
of this type of development. Let the following fourth-order determinant 

®12 ®13 ®14 

^21 ^22 ^23 ^24 

^31 ^32 ^33 ^34 

^41 ^42 ^43 < 3^44 

be developed through the selection of the first two columns for the forma- 
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tion of minors. All possible two-rowed minors are systematically formed 
as the rows: 1,2; 1, 3; 1,4; 2, 3; 2,4; 3,4 are selected from these columns. 
The sign-controlling factors of the corresponding algebraic complements 
are respectively: 


(_l)l+2+l+2 ^ 

^_ —"I 

(_l)t+2+.+4 ^ 
(_l)l+3+2+3 ^ 

(_ 1)1+2+2-M _ _J 

(-1)'+2+3+4 = +1 


With the terms written down in this order, the development reads 


A = 

On 

^12 

X 

^33 

^34 

_ 

On 

^12 

X 

Clos 

^24 


®21 

a22 


^43 

^44 


®31 

^32 


(^43 

^44 

+ 

On 

ai2 

X 

^23 

^24 

+ 

O21 

^22 

X 

1 

^13 

^14 

O41 

a42 

^33 

(^34 i 

®31 

^32 i 

^43 

^44 


O21 

(I 22 

X 

^13 

ai 4 

+ 

<^31 

^32 

X 

013 

^14 I 


O41 

^42 

^33 

^34 

041 

^42 


^23 

^24 1 


By means of the Laplace development a determinant may evidently be 
evaluated in a variety of ways. One possible method of evaluation consists 
in repeatedly applying the simplest form of development given by Eqs. 17 
and 18. In the first step of this process, the development is given by the 
sum of n terms, each of which is the product of an element and an (n — 1 )- 
rowed cofactor. In the second step, each of these cofactors is similarly 
developed, thus yielding for the determinant A a sum of w(m — 1) terms, 
each of which consists of the product of two elements and an (« — 2)- 
rowed cofactor. As the process is continued one recognizes that the final 
evaluation of A is given by the sum of n! terms, each of which consists of 
the product of n elements. 

The determinant is, therefore, a rational integral function, homo¬ 
geneous, and of the nth degree in its elements. In any term of the final 
evaluated form, the appearance of the product of an element with another 
element of the same row or column is not possible. This fact is readily 
appreciated by noting in the term 012 ^ 12 , for example, that the cofactor 
A 12 contains no elements of the first row or second colunrn. Hence none 
of these elements can subsequently appear in a term containing ai 2 . The 
determinant is, therefore, a linear function in the elements of any one row 
or column. 
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5. Other methods of evaluation in numerical or functional 

FORM 


The evaluation of a determinant by means of the Laplace developn 
ment, although useful for numerous analytic investigations, is a long and 
tedious process. The solution of simultaneous linear equations by means 
of determinants, as discussed in Art. 8, is usually found in numerical 
problems to involve a larger number of component operations than a 
systematic process of elimination. This situation is true even when the 
determinant and cofactors are evaluated by the method given in Art. 2, 
although this method parallels the elimination process in its essential 
steps. 

Alternative abbreviated methods of solving such equations are given 
in Arts. 7 and 11 of Ch. II. From a broader standpoint it is well to be 
familiar with numerous processes of evaluating determinants, so that the 
particular conditions of a specific problem may be met most expeditiously. 
In this regard the following remarks may also prove useful. 

Evaluations of two of the simplest cases by means of the Laplace 
development method are written down so that their resultant forms may 
be examined. 



an 

ai2 


^21 

^22 

ail 

ai2 

<^13 

^21 

^22 

^23 

^31 

^32 

^33 


= Q'ii(l22 — ^ 21^12 


aiia22<^33 + ^^12^23^31 + ^^13^21^^32 
— a3i<Z22^13 ^32^23^11 ““ ^33^21^12 


[ 21 ] 

[ 22 ] 


By inspection of Eq. 21 it may be said that the value of a two-rowed 
determinant is given by the product of the elements on the principal 
diagonal less the product of the elements on the conjugate diagonal 
(lower left to upper right) as indicated in the following by arrows: 


principal 

diagonal 


Oil ai2 

V 


negative product 


conjugate 
diagonal ^ 


p2i 


022* 

V'*“Poeitive product 


[23] 


This is called the diagonal product rule. It is applicable in extended form 
to the evaluation of a three-rowed determinant. Here there are three 
positive and three negative products, the positive ones being formed by 
elements on the principal and adjacent pardlel diagonals and the negative 
ones by elements on the conjugate and adjacent parallel diagonals in a 
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manner which is more easily understood if the first two columns are 
repeated so that the arrows may continue straight, thus: 



The result is seen to check with Eq. 22. 

An extension of this rule does not yield the value of fourth and hi g Vipr 
order determinants, as may readily be appreciated from the fact that the 
number of terms in the final evaluation must be »!, whereas the diagonal 
product rule yields only 2n terms. If n = 4, there remain 41 — 2x4 = 16 
terms unaccounted for after all diagonal products have been formed. 

From a more comprehensive study of determinants, it is seen that all 
the terms in the final evaluation may be foimd by writing down the group 
of elements on the principal diagonal 


®11 O22 C33 ' • * Ann 

and carrying out all permutations of the first subscripts, keeping the 
second subscripts fixed, or vice versa. In either case there are as many 
different products as there are permutations of n things taken n at a time, 
which is m! ’ 

In this process, the algebraic signs of the various terms are controlled 
by the rule that all permutations formed by an even number of inversions 
of the permuted subscripts represent positive terms, all others being 
negative. Thus for « = 4 the possible permutations are 


Even number of inversions 

12 3 4 

2 3 14 

13 4 2 

3 12 4 
3 4 12 

3 2 4 1 
2 14 3 
2 4 3 1 

14 2 3 

4 13 2 
4 2 13 
4 3 2 1 


Odd number of inversions 
2 13 4 

2 3 4 1 

13 2 4 

3 14 2 
3 2 14 

3 4 2 1 
12 4 3 
2 4 13 

14 3 2 

4 12 3 
4 3 12 
4 2 3 1 
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The twenty-four terms written with these as the first or second set of 
indexes, the fixed set being 1 2 3 4, and prefixed with algebraic signs 
according to the stated rule, represent the evaluation of the fourth-order 
determinant. 


6. Bordered determinants 


A determinant of given order may be transformed into a determinant 
of higher order without changing its value, as is readily seen by applying 
the ideas of the Laplace development to the following example: 


an a\2 
®21 ^22 


1 

“0 


0L2 

0 

1 


P 2 

0 

0 

ail 

d'12 

0 

0 

d'21 

d22 


[25] 


The elements ao, ai, a 2 ) Pi, P 2 niay have any values. The process can 
evidently be varied by placing the zeros to the right or above or below the 
rectangle containing the a^s. The resulting form is referred to as a 
bordered determinant. 


7. Products of deteriviinants 


The product of two determinants of like order can be expressed as a 
single determinant of the same order. If the two determinants are initially 
not of the same order, one of them can be bordered. In the present discus¬ 
sion the determinants can, therefore, be assumed to have the same order. 

The procedure for obtaining the elements of the product determinant 
is best illustrated by means of a simple example. By the Laplace develop¬ 
ment the transformation of the following product is justified: 


A XB 


ail ai2 

^21 ^22 


X 


^11 bi2 
621 ^22 


dll ®12 - f 0 

d'21 d^22 ^ — 1 

0 0 612 

0 0 ^21 ^22 


[26] 


According to rule IV, Art. 1, the resultant fourth-order determinant may 
be modified in the following manner without changing its value. First 
the 611 -multiplied elements of the first row and the 612 -multiplied ele¬ 
ments of the second row are added to the corresponding elements of the 
third row, giving 


dll 

dl2 

-1 

0 

d2\ 

d22 

0 

-1 

dll 

C21 

0 

0 

0 

0 

^21 

622 


[27] 


in which 


Cii = diihii + d2ibi2 

C21 = di2bii H- a22bi2 


[ 28 ] 



12 


DETERMINANTS 


\Ch.I 


The object of this transformation is to produce zeros in place of the ele¬ 
ments hii and 612 in the fourth-order determinant of Eq. 26. Now both 
the 621 -inultiplied elements of the first row and the 622 -inultiplied elements 
of the second row are added to the corresponding elements of the fourth 
row, giving 

®12 
<l21 ®22 

Cii C 21 0 

C 12 C 22 0 


AXB = 


0 

-1 

0 

0 


[29] 


where 


C 12 — ^ 11^21 + 0^21^22 
C22 ~ ^12^21 “t~ ^22^22 


[30] 


By the method of Laplace’s development the determinant of Eq. 29 is 
simply 


AXB = 


Cll 

C21 


(^11 

C12 

Ci 2 

C22 


^21 

C22 


[31] 


the second form being obtained by an interchange of rows and columns. 
Examining the expressions for the elements as given by Eqs. 28 and 
30, it is observed that they are formed by multiplying successive elements 
in the columns of the determinant A by successive elements in the rows of 
the determinant B and adding the results, the specific columns and rows 
involved being indicated by the first and second subscripts respectively 
on Cik- Thus Cii is formed from the elements of the first column of A and 
those of the first row of B; cu is formed from the elements of the first 
column of A and those of the second row of B, etc. More briefly, the c's 
are said to be formed by multiplying the columns of A by the rows of B, 

Since the individual values of the determinants A and B are unchanged 
by writing their rows as columns, it is clear that the value of the product 
determinant is unaltered if its elements are formed by multiplying either 
the rows or columns of A by either the rows or columns of B, The elements 
of this resulting determinant may, therefore, be formed in any of four 
different ways. Although the individual elements thus obtained are 
different, the value of the resultant determinant remains the same. 

A straightforward extension of the method used in the above example 
shows that the process of forming the elements of a determinant repre¬ 
senting the product of two given determinants A and B follows the same 
general rules when A and B have any order. This result is summarized 
in the statement 


flu ... 

’ ^In 

V 

611 

• • • bln 


* 

• • Cm 

Clnl • * * 

^nn 

A 

Ki 

* '■ bnn 


^nl ’ 

* * Cnn 


[ 32 ] 
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with any one of the following four relations: 

Cih = dilhkl + (Ii2^k2 + • • • + diffikn [ 33 ] 

C%k = diibik + (Ii2b2k + • • • + dinbrOt [ 34 ] 

Cih = dubkl + d2ibh2 + • • • + dnibhn [ 35 ] 

Cik = diibih + d2ib2k + * ' • + dnibnh [ 36 ] 


On the right-hand sides of the last four expressions, the indexes i and 
k have fixed values for any one of the Since the first index refers 
to a row and the second to a column, it is recognized that the four repre¬ 
sentations for Cik above correspond respectively to multiplying rows of A 
by rows of B, rows of A by columns of B, columns of A by rows of B, and 
columns of A by columns of B, 

8. Linear Equations 

One of the most important uses for determinants is in the solution of 
linear simultaneous equations. A set of n such equations involving n 
unknowns reads 

diiXi + di2X2 H-+ dinXn = yi 1 

^ 21^1 + ^ 22^2 -}-•••+ d2nXn =3^21 r 27 l 


d„iXi + dn 2 X 2 H-+ dnnXn = Vn J 


The object is to determine the values Xi ••• Xn in terms of the values 
yi • • • yn and the coefficients dik which are the elements of the determinant 
of this system of equations. This determinant is given by Eq. 1. 

Let the equations in the set (Eq. 37) be multiplied successively by 
the cofactors An, A 21 , • • • + Ani* Subsequent addition yields the 
equation 

(diiAn +^^ 21^21 + • ' • ~hdnlAnl)Xi 

+ (^12.4 11 +a22A2l + • • • ~hdn2Anl)X2 
+ (^ 13^11 +^ 23-421 + • • • +dn3Anl)X3 


+ (dinAn+a2nA2iH - +dnnAnl)Xn=Anyi+^2iy2'i - hAniyn [38] 

Here the coefficient of Xi is recognized as the Laplace development of the 
determinant A with respect to the elements of the first column, as given 
by Eq. 18 for ^ = 1. Similarly, the coefficient of X 2 is seen to be the 
Laplace development, with respect to the elements of the first column, of 
a determinant which is formed from A by replacing the elements of the 






determinants 


ICkl 


£rst column by those of the second column. This coeSdent, therefore, 
is the determinant 


ai2 

ai2 

^13 

^In 

U 22 

a22 


0'2n 

an2 

an2 

^n3 

^nn 


which by rule VI, Art. 1, has the value zero. 

Similarly, the coefficient of is equal to the determinant A with its 
first column replaced by the third column. This is likewise zero, as are the 
coefficients of all the remaining x's. Equation 38 is, therefore, equivalent 
to 

Axi = Aiiyi + A2iy2 + • • • + Aniyn [40] 


whence 


Aiiyi + A2iy2 + * * * + Aniyn 
A 


In like manner the solution for X 2 may be obtained by multiplying the 
equations in the set 37 by the cofactors Ai 2 f -4 22 , * * • -4n2> respectively 
and adding the results. The coefficient of X 2 then equals A, and the 
remaining ones are zero. Hence there results 

Ai2yi + A22y2 + • • • + An2yn 


This result may be stated in general terms by assuming Eqs. 37 to be 
multiplied respectively by the cofactors Aik, A 2 ky • • • Ank and adding the 
results. The coefficient of Xk then equals A, and the remaining ones are 
zero, so that 


+ A2ky2 + 
A 


4 “ A nkyn 


For * = 1, 2, • • • n, this represents the desired solutions. 

The numerator of Eq. 43 is recognized as the Laplace development of a 
determinant which is formed from A by replacing its ifeth column by the 
column of y’s appearing on the right-hand sides of Eqs. 37. Thus the 
result, Eq. 43, may be written 
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IS 


ail 


yi 


^In 

^21 


ya 

^2,4+1 

(hn 

^nl 


y» 

^n,k-hl 

^nn 


ail 

ai2 • 

* * 



^21 

^22 * 

• • ^2n 



^nl 

an2 * 

^nn 



[44] 


A statement describing this form of the solution is known as Cramer^s 
rule. 

A significant feature in the derivation of these solutions is a recognition 
of the validity of the relation 

(a for * = 

(^liAlk + (^2i^2k + • • • + OniAnk == i k 


which justifies the step from Eq. 38 to Eq. 40. The companion relation, 
which is established in an analogous fashion, reads 

(^ilAlcl + + • • • + ainAbn = |q \ 

For i 9 ^ k this represents the Laplace development of a determinant whose 
ith and ^th rows are identical. Equations 45 and 46 may he looked upon 
as an extension of the relations expressed by Eqs. 18 and 17 respectively. 
The solutions to the set of Eqs. 37 may be written in the form 

^liyi + ^123^2 + • • • + binyn = 

^^213'1 + ^223^2 + • • • + 62 n 3 'n “ ^2 

bnljl + in23'2 H-f" Knyn = , 

in which, according to Eq. 43, the coefficients are given by 

hr, - ^ [48] 


In this result it is significant to note the reversal of the subscripts on A,r 
as compared with those on &.»• 

In case the elements of the determinant A fulfill the condition 

Oifc = an [49] 

the determinant is said to be symmetrical about its principal diagonal. 
It is dear from rule VIII, Art. 2, that the minors and cofactors of A then 
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also have this property, that is, 

Aik — Aki 


[50] 


and it then follows from Eq. 48 that the determinant of the system of 
Eqs. 47 is likewise symmetrical. In that case the subscript order in Eq. 48 
is, of course, unimportant. 

Equations 37 and 47 are mutually inverse systems. The one set repre¬ 
sents the solution of the other. Consequently by analogy to Eq. 48 the 
coefficients of Eqs. 37 may be written 

^ [ 51 ] 


in which 



[52] 


is the determinant of the system of Eqs. 47 and Bki its cofactors. 

Evaluating the product AB oi the determinants of the inverse systems 
of Eqs. 37 and 47 by substituting Eq. 48 into Eq. 34 gives 


Cik = 


O'txAkl + (li2Ak2 + «»» + ^inA kn 

A 


[53] 


Reference to Eq. 46 shows that 

_ f 1 for i = k 
~ 10 ioii^k 

Hence for the determinants of these inverse systems 


bn ■ 

* bln 

X 

ail 

• * • ^In 


bni ■ 

* bfin 



* * * ^nn 



The determinants have inverse values. 


[54] 


1 [55] 


9. Conditions for the existence of solutions 

The conditions under which a system of simultaneous equations such as 
the set 37 can have solutions may be seen from the form of these solutions 
as expressed by Eq. 44. For arbitrary values of yi • • • y„, a necessary and 
sufficient condition for the existence of these solutions is that the deter¬ 
minant A shall not be zero. If A is zero, in general no solutions exist. 

They may, however, still exist in case the determinant in the numerator 
of Eq. 44 is also zero, as it is if the y’s satisfy the conditions 

yi = OtiCii + a2ai2 + • • • + certain 


[56] 
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in which ai, • • • a„ are arbitrary factors. The column of y’s in the nu¬ 
merator of Eq. 44 is then a linear combination of the other columns of this 
determinant and can, by repeated application of rule IV, Art. 1, be re¬ 
duced to a column of zeros. 

When the y’s are expressed by the relations 56, the Eqs. 37 can be 
rewritten in the form 


®11 (*1 ~ “l) + ®12(*2 ~ <* 2 ) + ' ' • + Cln(*n ~ «n) = 0 
® 2 l(»^l — Oil) + ^22(^2 — OC2) + -|- a 2 n(Xn — a„) — 0 


Onl(*l «l) + ttn2(^2 ~ 012 ) -f- * * * -f- Onn(^n — «n) = 0 


[57] 


A special case of this sort occurs when all the y’s are zero. Then ai = 
aj = • • • = a„ = 0, and Eqs. 57 become identical with Eqs. 37 for 
yi = y 2 = • • • = yn = 0. This is called the corresponding homogeneous 
set of equations. For these, the Cramer rule as expressed by Eq. 44 yields 
the solutions in indeterminate form except when A 0, but then the 
solutions are all zero. They are spoken of as the trivial solutions because 
their existence is at once evident upon inspection of the homogeneous 
equations. 

Nontrivial solutions to the homogeneous set of Eqs. 57 exist only if the 
determinant is zero, but Cramer’s rule, Eq. 44, is of no use in determining 
them. In order to see how this difficulty might be overcome, it is helpful 
to consider the Eqs. 37 for the special case that one of the y’s, for example, 
y,-, alone is different from zero. Then, if it is assumed for the moment that 
the determinant is not zero and Cramer’s rule or Eq. 43 is applied, it is 
foimd that 


Xi 


A 


[58] 


In this special case the ratio of any two unknowns is given by 


[59] 


which is independent of the values of both y,' and the determinant A. 
It may be inferred, therefore, that Eq. 59 holds also when both y,- and 
A are zero. 

The correctness of this conclusion is demonstrated in a rigorous fashion 
in Art. 7, Ch. III. Meanwhile it is interesting to note that when the 
homogeneous set of equations has nontrivial solutions, these are not 
uniquely determined by Eq. 59, in which only the ratios of the unknowns 
are given. Any value can be assigned to one of them, and the r emainin g 
unknowns are then expressed in terms of this one. 
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The general conditions for the existence of solutions may be discussed 
as follows. The fact that the inhomogeneous equations 37 have solutions 
only when the determinant is not zero simply amounts to stating that 
these equations must be independent. If one is a linear combination of 
the others (in this case the determinant vanishes), then, speaking in 
physical terms, the data are insufficient to yield an explicit answer. 

In case the right-hand members of the Eqs. 37 are zero and all the equa¬ 
tions are independent (A 5 *^ 0), the system is overspecified from a physical 
point of view. The situation is like a deadlock, and nothing can happen; 
that is, only zero values for the unknowns can satisfy the equations. If 
one of the equations is a linear combination of the others {A = 0), this 
one may be discarded and one of the terms in each remaining equation, 
for example, that with Xn, transposed to the right-hand side. These 
(n — 1) equations may then be solved for the (w — 1) remaining un¬ 
knowns in terms of provided the determinant of this reduced set is 
not zero. If it is zero, this method fails, but so does the corresponding 
form of solution expressed by Eq. 59. 

This kind of failure in the method of solution indicates that two inde¬ 
pendent sets of solutions exist, but it is difficult to obtain a clear 
picture of this situation without the aid of such appropriate geometrical 
interpretations as are given in Ch. III. The present discussion is completed 
in that chapter. The material of the following article, however, is helpful 
in summarizing some of the characteristics of the determinant which are 
pertinent to the present problem. 

10. The rank of a determinant 

If in the determinant Eq. 1, there exists among the elements of each 
column the same linear relation 

+ OC2a2k + • * • + OlnGnk = 0 (fe = 1, 2, * • • w) [60] 

in which the a’s are arbitrary nonzero factors, the elements of any row 
are expressible as linear combinations of the corresponding elements of the 
remaining rows. If some of the factors ai • • • an are zero, this fact still 
holds for the elements of some of the rows. By repeated modification of the 
determinant according to rule IV, Art. 1, any one of these rows can be 
reduced to a row of zeros. Hence it is seen that a determinant is zero if a • 
relation of the form given by Eq. 60 exists in which at least one of the a’s 
is different from zero. 

Conversely, if the determinant is known to be zero, it is surely possible 
to find a relation of the form of Eq. 60, as is clear if Eq. 60 is written out 
for all the ^-values, thus 
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aiiai + a2\a2 + • • • + an\OLn = 0 

^12«1 + 0.22^2 + • • * + an20Ln = 0 I P 


^ln«l + 0 ' 2 n <^2 + • • ‘ + CLnnOLn = 0 J 

This is simply the homogeneous system of equations in which the deter¬ 
minant has its columns written as rows. It is called the transposed set of 
equations. According to property VIII, Art. 2, the transposed determinant 
is zero if the given one is. Hence, by the method discussed in the previous 
article, a set of nonzero a-values can be found to satisfy Eqs. 61. 

It is then also possible to find a set of nonzero jS-values satisfying the 
relations 


^l^il + + • • • + PnO'in = 0 (i = 1, 2, • • • w) [62] 

since they are simply a set of solutions to the untransposed system of 
homogeneous equations. 

It follows that if the elements in a row of a determinant are expressible 
as linear combinations of the corresponding elements of the remaining 
rows, the elements in a column of this determinant are similarly ex¬ 
pressible. 

When a determinant of order n is not zero, so that neither the relations 
60 nor 62 exist (except for zero a- and /3-values), it is said to have the rank 
r = n. If the determinant is zero but at least one of its (n ~ l)-rowe(l 
minors is different from zero, one set of a- and jS-values exist which 
satisfy the Eqs. 60 and 62. The determinant is then said to have the 
rank r — n — 1. If the determinant and all its (w ~ l)-rowed minors are 
zero but at least one of its (n — 2)-rowed minors is different from zero, it 
has the rank r = w — 2. In this case it is possible to find two independent 
sets of a- and /?-values satisfying Eqs. 60 and 62, and the homogeneous 
system of equations has two independent sets of solutions, as is discussed 
further in Ch. III. Corresponding statements for the condition that the 
rank is n — 3, w — 4, etc., are obvious. Finally, if the rank of a deter¬ 
minant is zero, all its elements are zero. 

The definition of rank facilitates the discussion of possible solutions to 
a system of linear equations. Thus the nonhomogeneous Eqs. 37 have 
solutions only when the rank of their determinant is n. The corresponding 
homogeneous equations have nontrivial solutions only if the rank is less 
than w, and they have p sets of independent solutions if the rank isn ~ p. 
A more lucid exposition of this line of reasoning is found in the chapters 
immediately following. 
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PROBLEMS 

1. Determine the rank of each of the following determinants: 


(a) 

1 

2 

3 

4 (b) 

3 

9 

20 

18 

(c) 5 0 

-2 

9 


2 

4 

6 

8 

8 

19 

40 

37 

0 5 

-11 

7 


3 

6 

9 

12 

13 

20 

47 

34 

-2 -11 

25 

-19 


4 

8 

12 

16 

20 

22 

59 

31 

9 7 

-19 

26 


(d) 12 

-5 

8 

(e) 

39 

24 

12 

5 (f) 6.5 

6.5 

4 

4 

0 

1 


24 

21 

2 

2 6.5 

17 

8 

-4 

3 

-4 


12 

2 

10 

3 4 

8 

4 





5 

'2 

3 

1 




2. Transform each of the above determinants to the triangular form, thus finding 
their values and checking the answers to Prob. 1. 

3. For each determinant in Prob. 1 whose rank is less than its order, find relations 
of the form of Eqs. 60 and 62. 

4. Using determinants (e) and (f) of Prob. 1, write down corresponding sets of 
simultaneous equations, denoting the right-hand members by yi, y 2 , * * * as in Eqs. 37. 
Solve these equations by means of Cramer’s rule. 

5. Repeat the solutions of the equations in Prob. 4 by means of a systematic 
elimination process. Compare the total number of multiplications and additions with 
those required m the solutions using Cramer’s rule. 

6. Evaluate the following determinant according to the pattern shown in Eq. 20. 

2 14 3 

6-12-4 
3-2 5 1 

-5 6 4 -1 

Repeat the evaluation through reduction to the triangular form and compare the 
total numbers of multiplications and additions required in the two methods. Derive a 
formula giving the total numbers of multiplications and of additions required for the 
evaluation of an wth order determinant by the method involving its reduction to the 
triangular form. 

7. Determine the solutions to a set of equations (like Eqs. 37) having the ac- 

0.5 0.5 0.5 0.5 

-0.866 0.*289 0.289 0.289 

0 -0.258 0.408 0.408 

0 0 -0.707 0.707 

companying determinant. Compare the set of equations representing the solutions 
with the given equations and note any obvious mutual relations existing between 
these two sets of equations. 

8. Given the two sets of equations 

n 

£ «<*** = y.- (« = 1,2, • • •«) 

Jb-l 


£ = Xk (i = 1,2, • • •«) 


and 
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which are solutions of each other, show that the corresponding determinants A and B 
have inverse values; that i&yAB = 1. A proof may be based upon the rule for forming 
the product of two determinants. 

9. In the following special nth order determinant 


a 

1 

0 

0 ••• 0 

1 

a 

1 

0 ••• 0 

0 

1 

a 

1 ••• 0 

0 

0 


Ola 


all the elements of the principal diagonal are equal to a\ those on the diagonals im¬ 
mediately above and below the principal diagonal are unity, and all the rest are zero. 
Derive the following recursion formula: 

Dn ~ (xOn—X — Bn—2 

applicable for n = 1, 2, • • • with the definitions: Do ~ 1 and Di =* a. From this 
recursion formula obtain an explicit expression for the determinant of order n which 
reads 


Dn = 


sinh (n + 1)7 
sinh y 


with y = cosh”* 


a 

2 


10. If the first and the last elements on the principal diagonal of the determinant 
in Prob. 9 are replaced by a/2, show that the resulting determinant has the value 

Dn = sinh (n ~ 1)7 \sinh 7 

while if only the first or last of these elements is a/2, the value is given by 


Dn = cosh ny 


11. Consider the determinant 


D = 


Ji 1 0 0 0 0 • • 

--1 di 1 0 0 0 •• 

0-1 da 1 0 0 •• 

0 0 -1 d4 1 O** 


Kidxr-dn) 


and show that this function • • • dn), called a simple continuanty possesses the 
recursion formula 

K{diy • • • dn) = dnK(dij • • • dn—1) + K{di, • • • dn-2) 


with 

K{di) = di, and i^(0) = 1 

12. Denote by Du the cofactor formed through canceling the first row and colunrn 
in the determinant given in Prob. 11. Make use of the results of Prob. 11 to show that 

Bii «(*,■■■<.) 1* I* 

which is known as a continued fraction. 

13. Show that 


K(diy • • • dn) - K(dnt • • • di) 
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and that the recursion formula given in Prob. 11 may alternatively be written 

K(di, • • • d„) = diK(d2, •-dn)+ K(dz, --dn) 

14. Show that the partial derivative of a determinant with respect to one of its 

elements equals the cofactor of that element. In symbols: * -4,*. 

15. Qonsider the cofactors A^h and A,t corresponding to the elements a,* and a^r 
in the same row of a determinant A, Show that the sum (^4,* + Agr) is equal to 
Agjt with the column involving the elements replaced by one with elements 

+ 1)^“^ or to Agr with the column involving the elements agj^ replaced by 

one in which the elements are Ogjt + 1)*~'‘ 

16. Using the type of reasoning involved in the previous problem, show that the 
fourth-order determinant may be written as the following sum of two third-order 
determinants: 

(^11^22 — ^12^21) CL2Z CL2A <l21 <*22 (^*18024 “ 0'\A(l>2z) 

(flll<232 — 012 ^ 31 ) OZZ O^ZA -h <^31 ^32 (<^13^34 — <^14^33) 

(^11^42 ~ (llZdAl) (^AZ O'AA ^41 ^*42 {O'lZO'AA — O^lAdAz) 

or as a variety of obvious modifications of these forms. 

17. Express in determinant form the condition that the three straight lines defined 
by 

diix + any -I- ai3 = 0 

a%ix 4 " a%2y + ^^23 = 0 
azix 4- azty + 033 = 0 
shall intersect at a common point. 

18. In the J^TF-plane the origin 0, and the two points P{xi,yi) and Qix 2 jy 2 ) 
determine a triangle. Show that the area of this triangle is expressible by means of the 
determinant 

1 xi yi 

2 X2 y2 

19. Using the result of the previous problem show that the area of a triangle 
determined by the points (:ri,yi), ( 3 : 2 ,y 2 ) and {xz,yz) is expressible as 

X xi yi \ 
iz X2 y2 \ 

^ xz yz \ 

Write the condition for which these three points lie on the same straight line. 

20. ax f by 4- rz 4- d = 0 is the equation of a plane. Its Intercepts on the co¬ 
ordinate axes are: x ^ —d a, y = -d/h, z = —d/c. Let n denote the normal from 
the origin to the plane. Its direction cosines are: 
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Consider a ix)int -Po(^o,yo>2o) for which axo byo -f- czq + d =• Z)o. Subtracting this 
equation from the original one gives a(x - xq) -f b(y - 3^0) -f c(z - 20) + i)o 0, 
from which it is clear that the length of the normal dropped from the point Pq to the 
plane is 

Do 

V -f -f c - 


These results and that of the j)rcvious problem are to be made use of to show: (a) 
That the equation of a plane passing through the three points Pi(. ti,3*1,21), 
P2(x2,y2,Z2) and PsC^'Sjysj^s) nia}^ be written in the form 


D(x,y,z) 



X 

y 

z 

1 

Xi 

yi 

Zi 

1 

•^2 

y 2 

22 

1 

Xo 

yz 

23 

1 


(b) That the cofactors of the first three elements of the first row, that is, 


yi 

Zi 

1 


2 l -Vi 

1 


Xi 

yi 

1 1 

y2 

22 

1 

f 1 

22 ^2 

1 

1 > 

X>y 

yz 

1 ( 

yz 

23 

1 


23 Xs 

1 


Xz 

yz 

1 1 


are equal to the projections of the area of th<^ triangle ujion planes normal to 

the .Y-, F-, Z-axes resjiectively ami that the square root nf the sum of the sciuares of 
these cofactors equals the area of this triangle, (c) That Do - Dixo^yo.zo) divided !)>' 
this square root equals the normal distance of a point P(,(ao,y(),S(,) from the plane, and 
hence that the volume of the tetrahedron whose vertexes are the iioints /V^PsP" is 
equal to one sixth the value of the determinant Do. 

21 . Three planes passing through the origin are represented by the equations 

ciix T- t/oy d- u.-js — 0 

h\x 4- h‘xy 4 * h- 3 ,z = 0 
d- Coy 4- C32 - 0 


Express in determinant form the condition for which these planes intersect in the 
same straight line and find the expressions for the direction cosines of this line. Given 
any two planes, what are the direction cosines of their intersection? 

22 . Write the following determinant as a polynomial in X: 


P(X) - 


nil ~ X (i\2 o.\z 

O21 a 22 — X 023 

fi’n f^z 2 (izz X 


and obtain expressions for the coefficients of the polynomial in terms of the determi¬ 
nant A and its cofactors. Indicate the forms of these expressions for an «th degree 
polynomial. 

23 . Prove that 


(a) 

(ail d- &I1) C \2 ' • • Cin 


<^11 C12 • ' ' Cin 


^^11 Cu • * * Clr , 


(a21 + 621) ^22 • * • C2n 


^21 C22 • • • C 2 n 

-f 

b 21 C22 • • • C2n 


d" bnl ) Cn 2 * * * ^nn 


flnl Cn 2 • • • Cnn 


Cn 2 * * * Cnn 


(b) If 


Cik = <^ik +j^ik 
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then 

ail 

012 

Ol8 


an 

612 

^13 

bn 

O12 

^13 ^11 

^12 

a\z 

= 

021 

022 

023 

— 

021 

^22 

t^23 

1 — ^21 

O22 

^23 — b2l 

^22 

023 


^31 

032 

033 


031 

^32 

^33 

^31 

O32 

bn bzi 

632 

033 

f 

an 

Ol2 

^13 


On 

^12 

Ol3 

bn 

012 

018 bn 

bi2 

^13 

+i 

021 

022 

^23 

+ 

021 

^22 

023 

-f* 1)21 

a 22 

023 *“ ^21 

622 

^23 

1 

031 

032 

^33 


031 

^32 

O33 

bn 

032 

033 ^31 

bz2 

bzz 

(C) If 




dik 

= dik — 

jbik 

i, k = 

1 , 2,3 





24. Let 


complex conjugate of Icifcl 

Cik ~ d'ik ~i~ j^ik ijk — \y'2y'‘*fl J ~ 1 


Prove that |c»vtj is a complex number with the following law of formation: 

(a) |r;,7:| is equal to the sum of 2" determinants of order n, 2""^ being real and 
2""^ pure imaginary. 

(b) The real determinants have an even, or zero, number of b columns. The 
imaginary ones have an odd number of “ b columns. 

(c) If w is the number of “ b ” columns in any determinant in the expansion, the 
sign and complex character of the determinant are given by For a given value of w, 
there are several determinants which contain m b columns; their number is given 
by 

n(n - l)(n — 2) * in — w + 1) 

m ! 

(d) By using the above properties show incidentally that 

1 + » + +... + 1 ;. 2 . 

2! 31 n! 

25 . If - yik(t), for i, k = 1 , 2 , •••«, are single-valued, difTerentiable 

functions of the independent variable ty show that 


y'n yn • 
y'n y-ii • 

• yin 

• :V2h 

4 - 

yn /12 * 

y^22 * 

• yin 
y 2 n 

4-.. 

• 4- 

vii yi2 • 

>'21 ^22 • 

• y'lu 

• y''>n 

y',n yni • • 

y nn 


y'nz * • 




>'nl yn2 

■ • 3''nn 


v'li 

3’^12 • 

• r'lH 

Vii 

y\2 * 

• yin 



vn 

yi2 • 

* >’lH 

>’21 

>’22 • 


V^21 

y^22 * 

• y'zn 

O- .. 

• 4- 

>'21 

'V22 * 

• y2n 

ym 

3'n2 • ' 

ytin 

>'«1 

yu2 •• 

■ • ynn 



l/«i 

y'ni • ■ 

’ * y tin 


in which 


26 . In terms of the ii independent functions 

yk yk{t) for A’ = 1, 2, • • • w 
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(differentiable up to and including the nth order), construct the following determinant 
(the so-called Wronskian of those functions): 


yi 

>2 

3^3 

•** J'n 


y 2 

y's 

• • • /n 

y'l 

y '2 

y"z 

• • • y"n 

yi(n-l) 


yjCn-l) 

• • • 




dt^ 


iyk) 


If these functions are connected by a linear relation of the form 


^lyi -h + Azys H— • + Any,, == 0 


in which the are constants, show that the above determinant vanishes identically. 
Hint. Differentiate the linear relation successively n — 1 times so as to obtain 

H- A-Any'n =0 

Aiyi^^-^^ + • • • -f = 0 


Together with the original relation, one then has a set of n equations. From these, the 
value of any function y^., for example, yi, and its first (n — derivatives can be 
obtained. Substitution into the Wronskian, followed by an exDansion according to 
columns, leads to the desired result. 

27 . Using the determinant, A, as defined in Prob. 26 , show that 


yi 


ys 

yn 

y'l 

y '2 

y'z 

y'n 

y,(n-2) 


-y3f”--2) . . 


yi(") 

y2^”) 

yjOO . . 

/XI (») 


Hint. Use the result of Prob. 25 and observe the resulting structure of the rows. 
2<S. If (with reference to the situation given in Prob. 27 ) there exists a set of n 
relationships (differential eciuations) of the form 

+---+pnyr=0 


for 


r - I ^ • 

r A, 


in which the coefficients po, pi, />2, *' * pn arc constant or variable, show that 


(a) 



in 

Pi) 


A 


(b) 




in which An is the integration constant. 

Hint. Give r the values 1, 2 , • • • n and obtain, from each equation, the value of 
y/”\ Substitute these values into the last row of the expression in Prob. 27 . 

29 . Given 

Xk = Xkit) ioik - 1, 2, • • • n (a system of n unknown functions of /) 
yk = ykit) for ^ = 1, 2, • • • « (a system of n known functions of t) 

and 

Oik for f, ^ = 1, 2, • • • n (a collection of ir constants) 
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These quantities are related by the following system of first-order, first-degree, linear 
equations 

ouii + a2kX2 + • * • + dnk^n - yk for ^ = 1 , 2 , • • • tt 
Show that a solution of this system (the particular one) is given by 


Xic = 


k yidt A 7 jc J* 


A Ik I yidt A 7 jc I y^dt A 


‘S’- 


dt 


|a«| 


in which the AikS are cofactors of the determinant 
30 . Show that 


1 

1 

1 • 

•• 1 

1 

2 

22 .. 

.. 2^-1 

1 

3 

32 . • 

• • 3 ”-i 

1 

n 


■ • 


= 1 ! X 2 ! X 3 ! • • • (n - 1) ! 


Hint, Reduce the determinant to the diagonal form. Use Barlow’s tables of squares 
(pages 202 to 206 ) for the powers of integer numbers and observe the law of forma¬ 
tion. 

31. 


Uk - Ukixi - • • Xr,) ior k = 1, 2, • • • w 

are n single-valued differentiable functions of the independent variables .ri, 0*2, * • • Xn. 

The “ Jacobian ” of these functions is, by definition, the following functional 
determinant: 


/UlMn ’ - ^,A 
\XlX2' • -XnJ 


du\ 

du\ 

dui 

dxi 

dX2 

OXn 

dU2 

(9«2 


dxi 

dX2 

dXn 

dUn 

dUn 

dUn 

dxi 

dX2 

” dXu 


Suppose the variables a'i • • • are changed to the new independent variables Zi • • • Sn 
according to the equations of transformation 

Xk ^ Xk{zi--- Zn ) for ^ = 1, 2, • • • n 

The original Uk functions are now 

Uk = Ukizi • • • s„) for ^ = 1, 2, • • ’ n 

and their Jacobian with respect to the variables Zi • • • Zn, for example, Ji, differs from 
J only in that the variables x are replaced by corresponding s’s. 
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(a) Show that the above Jacobians are connected by the relation 


/i = 


dxi 

dxi 

dxi 

dzi 

dZ2 

dz„ 

dX2 

dX2 

6x2 

dzi 

dZ2 

dZn 

dxn 

dXn 


dzi 

dZ2 

dz 


XJ 


(b) Extend the above result so as to consider subsequent transformations of the 
form 

Zj = £,(ri, ^ 2 , • • • rn) ioYj =1 2, • • • « 
rp = rp{tx, /2, * • * in) for = 1, 2, • • • n 

(c) What happens with the last Jacobian when any intermediate functional 
determinant is identically zero? Hint. Apply the rule for differed:tiation which reads: 


dur _ dur Sxi 

dZa dXi dZa 


32. Let 


= 1 , 2 , •• 

ajk =* djkixh " Xn) forj, ^ = 1, 2, ■ 


be a system of differentiable functions of the independent variables xi^ • • Xn^ 
Through the introduction of a new set of independent variables xi, ^ 2 , * • • 2n by means 
of the functional relations 

Xk = Xki^i, ^ 2 , * • • Xn) ior k = 1, 2, • • • w 

the system of functions ajk in the old variables goes over into the transformed system 
ajk in the new variables. 

Accepting the result that ajk goes over into djk in accordance with the law of 
transformation 

dXjdXk , . N 

dpq^ = X) 9 ” 1 > 2, • • • w) 

y = ljt=l dXpdXg 

prove that the determinant |a,vfc| is transformed as indicated by 

~ \^jk\ X 


dxi 

dxi 

6xi 

d£i 

di2 

dZn 

6x2 

6X2 

6x2 

asi 

6x2 

6Xn 

dx„ 

dx„ 

dXn 

dSi 

dit " 

’* din 


in which 
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33. The expression for the three-dimensional volume element in a general system 
of co-ordinates is given by 

dxz 


in which 


gjk — 


" ~ ” dx^ Bxv 
dxj dxk 


V ^ 1,2,-‘n 


j ^ 1,2, — * n k - 1,2,* — n 


If the co-ordinate system is orthogonal, the gjk system has the property 

f ^ 0 forj = k 
^'*[ = 0 foTj^k 

Check the values of ; for the dififerent co-ordinate systems and laws of co- 

ordinate transformation given in the following table: 


Name 


Cartesian 


Circular 

cylindrical 

Elliptic 

cylindrical 

Parabolic 

cylindrical 


Bipolar 

cyUndrical 


Spheroidal 


Spherical 


Equations of Transformation 

\ Xi xi 
X2 = ^2 

ra = xz 
x\ == xi cos ^2 
X 2 = xi sin ^2 

Xz = X3 

jci == c cosh xi cos fa 
X 2 — c sinh Si sin $2 
^■3 — xs; c - const. 

[ Xi == I (Xi^ - X2^) 
j Xz = 5 :iX 2 
[xz = xz 

_ a sinh xi 
cosh Xi — cos X2 
a sin Xz 

cosh xi — cos X 2 
xa = xa; a = const. 

I xi - c cosh xi cos X 2 ; c ~ const. 
JC 2 = c sinh xi sin ^2 cos xz 
Xz = c sinh xi sin X 2 sin xz 

1 x 1 = xi cos X 2 sin xa 
X 2 = X] sin Xz sin xa 
Xa = xi cos Xa 


__ 

1 

r^Ccosh^xi ~ cos^^z) 

(xr + x.J) 

a- 

(cosh Xi — cos xa)^ 

r^(cosh^ xi — cos‘ X 2 ) sinh xi sin X 2 

f sin Xa 


34. Given the multiple integral 

/ = y J ' ' *»,••• *n) dxi dxi - •• dx„ 


in which *i, * 2 , • • • x„ are the independent variables. If new variables 2i, 52, • • • 5, 
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are introduced in accordance with the relations 

Xk *= ^ 2 , • • • 2n) for ^ = 1,2, • • • n 


it can be shown that the above integral becomes 

j ^ J* • * • J* ^2, • • * ^n) d^l df 2 * • • din 


in which J is the determinant given in Prob. 32. 

Compute the value of the determinant J for each set of transformation functions 
given in the second column of the table in Prob. 33. 

35. Given the following system of m + n linear equations involving the m + n 
unknowns ocx for X = 1, 2, • • - and for p = 1, 2, • • • m, with n > tn: 

/*=n p=m 

2^ AxftXfj, — exx + ^ Cpapx =0 for X = 1, 2, • • • » 

pssl p=l 

^ appXp = 0 for p = 1,2, • • • m 
#1 = 1 


(a) Write in determinant form, according to the above order of these equations, 
the condition for the existence of nontrivial solutions. 

(b) Show that this determinant is a polynomial in e of the degree n — m. 

(c) Using Laplace’s development with respect to the last m rows, show that the 
total munber of wth-order minors which can be formed is given by 

(n + in){n + w ~ \){n m — 2) • • * {n ^ \ 


and that only 

n{n — 1)(m — 2) •••(«— w -f- 1) 
m ! 

of these are not necessarily zero (the rest being identically zero). 



CHAPTER II 


Matrices 

1. Linear transformations 
In Art. 8 of Ch. I, the system of linear equations 
^ 11^1 + ^ 12^2 4 - • • ‘ = y \ 

^21^1 + ^22^2 + “ • • + ^2n^n = ^2 


^nl^l 4” CLn2^2 4“ * * * 4" ^nn^n — 

is considered to relate a set of unknown quantities Xi •• Xn to a set of 
known quantities yi • • • yn- An alternate point of view, which plays an 
important part in the analysis of physical problems, is to look upon these 
equations as relating a set of given variables to a new set of 

variables yi • * • yn* The equations are said to transform the old variables 
into new ones. In this sense the set of Eqs. 1 is spoken of as a linear 
transformation. 

The transformation is characterized completely by the coefficients 
Oik, Since not only the values of the coefficients but also their relative 
positions in the equations are significant in this resi)ect, a symbolic form 
for the characterization of the linear transformation is given by means of 
the rectangular array 



ail 

ai2 • 

• O'ln 

a = 

^21 

022 * 

• a2n 


_^nl 

an2 • ■ 

^nn_ 


which is called the matrix of the transformation. 

Offhand, it might be thought that the determinant could serve this 
purpose, but here it must be recalled that the determinant is a function 
of the coefficients and not merely a symbolic representation of them in 
their relative orientations. The determinant has a value; the matrix, 
on the other hand, is merely a picture and has no value other than that 
which it conveys by its structural composition. For the moment it has but 
one reason for existence, namely, that it is easier to write down than the 
system of Eqs. 1, yet contains essentially the same information. 

In outward appearance the determinant differs from the matrix only 
in that the latter is enclosed in square brackets whereas in the determi¬ 
nant the elements are enclosed between vertical lines. In this book, an 
upper-case script letter is used to denote the matrix and the upper-case 
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italic letter denotes the corresponding determinant. Thus the matrix 2 
is denoted by Q and the corresponding determinant by A. 

Just as determinants facilitate the study of linear equations and re¬ 
lated problems, so the algebra of matrices is justified in that it facilitates 
the manipulation of several sets of linear transformations. The rules of 
matrix algebra are chosen with this end in view and are otherwise quite 
arbitrary except that they must, of course, be self-consistent. 

A matrix does not necessarily have the same numbers of rows as 
columns. Its form is therefore more flexible than that of a determinant, 
which must always be square. If the matrix has m rows and n columns, 
it is referred to as having the form m by w, or it may simply be called 
an (ww)-matrix. When m equals n, the matrix is said to be of order 
n. In the extreme cases in which the matrix consists merely of a single 
row or a single column, it is referred to as a r(m matrix or a column 
matrix respectively. These special foians occur frequently enough to 
warrant the use of some abbreviated notation to distinguish them. 

The notation used in this text for a row matrix is 

^ = [Ofl Qr2 * • • otr^ [3] 

A column matrix is indicated as shown by the equation 



At times it becomes necessary to have the abbreviated symbol for a 
matrix indicate the number of rows and columns involved. A matrix 
having m rows and n columns is written 

^11 * * * 

t^mnj ~ .. 

J^ml * ’ * 

A less specific notation, however, is sufficient when the number of rows 
and columns either is clear from the discussion involved or is immaterial. 

If a rule for the multiplication of matrices is properly chosen, the linear 
transformation, Eq. 1, may be written as a matrix equation. One of the 
four alternative rules for forming the product of two determinants (dis¬ 
cussed in Art. 7, Ch. I) may be used for this purpose. It is conventional 
to choose the rule expressed by Eq. 34, Ch. I. Thus in order to form 
the product C of two matrices Q and £B, as indicated by the equation 

e X 3 = e [6] 
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the elements in C are obtained by multiplying the rows of (2 by the 
columns of SB, as described in detail for the multiplication of determinants. 

With the adoption of this convention, the matrix equation replacing 
Eq. 1 reads 


<l\\ 

«21 

^12 

«22 

• * 

• * ^2 n 

X 

X2 


1 

. . 

-1 


^ w 2 

O'nn ^ 






[7] 


which may be abbreviated as 

<3 X x] = y] 


[ 8 ] 


The element yi, which is the (l,l)-element in the column matrix y], is 
obtained by multiplying the elements in the first row of (2 by the corre¬ 
sponding elements of the first column (the only column) of x] and adding 
the results. This gives 

aiiXi + ai2X2 + • • • + = yi [9] 


which is the first equation in the set 1. Similarly, y 2 which is the (2,1)- 
element in the matrix y], is formed from the second row of Q and the 
first column of x], thus 

«21^1 + <^22^2 H-- + ^2n^n = ^2 [ 10] 


This is the second equation in the set 1. The remaining equations in this 
set are similarly contained in the matrix equation 7 or 8. 

It should be noted that the column matrix y] has no elements for the 
position (1, 2), (1, 3) • • • or (2, 2), (2, 3) • • • , etc., because it has only 
one column — the first column. For the missing elements, or zero elements 
in y], the matrix product expressed by Eq. 7 automatically yields zeros 
according to the adopted product-forming rule because the column 
matrix x] has no second, third, • • • , etc., columns; that is, the elements 
in these missing columns of the matrix x] are all zero. 

The present argument requires for completeness a statement of the 
rule that two matrices are equal only when all corresponding elements 
are equal. Specifically, if two matrices 9 and S with elements prs and 
Qrs are to be equal, that is, if 

= a [11] 

it is necessary that 

Pra = [l2j 

for all values of the indexes r and s. For example, the left-hand side of 
Eq. 9 is the (l,l)-element of the product of Q and x] in Eq. 7, and yi, 
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the right-hand side of Eq. 9, is the (l,l)-eleinent of the matrix y] in 
Eq. 7. This rule for the equality of two matrices is, however, so obvious 
that it hardly needs emphasis. 

It should be clearly recognized that the objective of obtainmg a matrix 
equation equivalent to the transformation 1 could have been met just 
as well by the adoption of any one of the other three methods of forming 
elements in the product matrix according to the rules of multiplying 
determinants and by suitable modification of the form of the matrix 
equation. The choice of the rule by which the rows of the first matrix 
in the product are multiplied by the columns of the second is arbitrary, 
but once it is adopted, consistency requires that it be looked upon as the 
rule. There are no alternatives as in the multiplication of determinants, 
because the alternative procedures, if applied to the example illustrated 
by Eq. 7, do not all yield the same final set of equations. 

That the adopted rule for matrix multiplication is not compatible with 
the commutative law in forming algebraic products is likewise apparent. 
Thus if (2 and are two matrices, the product Q X S is different (and 
has a different manipulative significance) from the product SB X S. 
Thus in general 

Q X SB SB X fl [13] 

in matrix multiplication. 

The utility of being able to write a transformation in the compact 
matrix form is appreciated when several transformations are to be carried 
out in tandem. In addition to the transformation 1 from the variables 
Xi x„ to the variables yi • • • yn, it may be necessary to transform 
subsequently to a set of variables Zi • • • z„ by means of the equations 

ii\yi + &i2y2 d-h hnyn = Zl 

^2iyi + ^22^2 4- • • • + b2nyn — Z2 


^»niyi + b„2y2 4-4- bnnyn = 2„ 

with the transformation matrix 



With the additional definition of the column matrix 
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this transformation takes the compact form 

a X y] = s] [17j 

The direct transformation from the variables to the final 

variables 2 i • • • 2 „ is obtained by substitution of the expression for y] 
according to Eq. 8 into Eq. 17, which gives 

fS X 3 X x] = z] [18] 


or, more compactly, 


C' X x] = 2 ] 


[19] 


in which the resultant transformation matrix C is given by the product 

e = ffi X a [20] 


The convenience of the matrix method of handling transformations 
becomes clear if it is contrasted with the additional labor involved when 
a specific example of the above transformation is carried through by 
means of the usual substitution process. The individual transformations 
may be assumed to be the following simple ones: 

anXi + ai2X2 = yi | r-j-i 

021 X 1 + 022 X 2 = ya J 


and 

i\\y\ + ^i2y2 = 2i I 
^ijl + b22y2 — ^2 j 

Substitution of Eqs. 21 into Eqs. 22 gives 

+ ^12^2) + ^ 12 (® 21^1 + 022^2) = 2 i ] 

f*2l(<^ll^l + <'^ 12 * 2 ) + ^ 22 ( 021^1 + ^ 22 * 2 ) = 22 J 

Multiplying out and collecting terms with Xi and X 2 , one obtains 

(i>n®ii + bi2a2\)xi + (inOi 2 + 612022)^2 = 2 i 1 

(621^11 + i22‘*2l)^l 4- Q>21<^12 + 1>220’22)X2 — Z2 j 


[ 22 ] 

[23] 


[24] 


The coefficients in these equations are recognized as the elements of a 
matrix formed from the product 

[?■' j'dxh' [25] 

\_b 2 i O 22 J L®2I ®22j 

The ease of manipulation and circumspection resulting from the use 
of the corresponding matrix equations is proved even more conclusively 
in the applications discus^d in Ch. IV. Meanwhile it is necessary to 
study the rules governing various additional algebraic manipulations 
with matrices. 
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2. Addition of matrices 


By the sum of two matrices (2 and S is meant a resultant matrix C 
whose elements are equal to the sums of corresponding elements of Q and 
Explicitly, if 


ail ' 

* ^In 


fin • 

* * ^In 



= 

. . _ _ 


* 


: 

_1 



[26] 


then 


Q + a 


e = 


(®n + ^ll) • • • (flln + iln) 


L ^ml) * * * (^^mn 4“ ^mn\ 


[27] 


Similarly, the difference (2 — S yields a matrix whose elements are 
the differences of corresponding elements of (2 and S. 

Evidently the matrices (2 and ® should have the same number of rows 
and columns, or the missing rows and columns of one may be regarded 
as composed entirely of zeros. 


3. Multiplication by a factor 

If a matrix is multiplied by a factor, each element of the matrix 
becomes multiplied by this factor; thus 


dll • 

• • ^In 


I_ 

, - 

_^7nl 

* 


* 

* * 


As is clear from the fact that if the factor k is zero, the matrix must be 
zero, which is true only when all elements of the matrix are zero. 

It should be observed that this rule is distinctly different from the 
corresponding one for determinants, in that the determinant becomes 
multiplied by a factor when the elements of only one row or column are 
multiplied by this factor. 


4. Multiplication of matrices 

The operation of multiplication is introduced in Art. 1 above, but 
several additional remarks are necessary to complete the discussion. 
The individual matrices entering into the product (2 X ffl may not have 
the same niunber of rows as columns, but it is clear from the manner in 
which this product is carried out that the number of columns in (2 (the 
number of elements in a row of (2) must equal the number of rows in 
(the number of elements in a column of SB); otherwise some of the 
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products of elements in the rows of fl with corresponding elements in the 
columns of SB cannot be completed, for want of either one or the other of 
the corresponding elements. For example, when expansion of the follow¬ 
ing product, 


fail ai2 bi2l 

C^2\ ^22 ^23 J L^21 ^22 J 


[29] 


is attempted, it is found that there are no elements in the matrix SB by 
which the elements ais and <223 may be multiplied. These matrices are 
said to be nonconjormable. They become conformable when a third row is 
added to the matrix SB. This row may, of course, consist entirely of zeros. 

Curiously enough, conformability does not require that the number of 
rows in (2 be equal to the number of columns in SB. Thus the formation 
of the product 


r ail 

^12 

^13 

V 

'bn 

b^i 

L^21 

^22 

^23 J 

y\ 

J 32 J 






[30] 


is considered straightforward, it being tacitly understood that the matrix 
£B is interpreted as equivalent to 


611 O' 

^21 0 

631 0 _ 


[31] 


but never that it is equivalent to 


0 

bn 

0 

621 

0 

^31, 


[32] 


It is useful to observe that the matrix formed from the product Q X S 
has as many rows as Q and as many columns as fB. For example, the 
product 30 yields a matrix with two rows and one column. In general, 
if the matrices are denoted more specifically as [a,„„] and [b„p], then 

[<^mji] X [f'np] = [Cmp] [33] 

These matrices are conformable because (3 has n columns and £B has n 
rows. 

Similarly the product of three conformable matrices reads 


[^mn] X [f^np] X [Cp^] \Amq\ [34] 

Here the resultant matrix has as many rows as the first matrix and as 
many columns as the last one entering into the triple product. 

To carry out the product of three or more matrices such as Q X X C 
the component product Q X SB may be evaluated first and the resultant 



Ait.4\ 


MULTIPLICATION OF MATRICES 


sr 

matrix multiplied into C, or G may be multiplied by the resultant of 
X C. In symbols this procedure is stated by the equation 

Gx£Bxe = (Qxffi)xe = Qx(£Bxe) [35] 

In other words, the associative law holds in matrix multiplication. 

This fact may prove useful in minimizing the amount of labor involved 
in carrying out a multiple product. Observe that the multiplication of the 
two matrices 

[®mn] X 

involves the operations 

m X n X p multiplications 
m X (n — l)X p additions 
Consequently a triple product in the association 

([®OTn] X [^npD X 

involves the operations 

mXnXp + mXpXq multiplications 

mXin — l)Xp + PtX(p — l)Xq additions 
and in the association 

[Oa»n] X ([^np] X [CpJ) 

the operations are 

nXpXq + mXnXq multiplications 

nX{p — ^)Xq + inX{n — V)Xq additions 

As a numerical illustration let it be supposed that m = n = 6, 
p = and g = 4. Then the operations 39 are ten multiplications and 
five additions, whereas the operations 41 amount to 48 multiplications 
and 20 additions. 

Since, as pointed out earlier, the commutative law does not hold, the 
order in which the matrices enter into the multiple product must be 
carefully observed. In Eq. 35, for example, the component product 
(Q X ffl) is /»05/multiplied by C, and the component product X C) is 
j&rcmultiplied by (2. 

In this connection it is to be noted that the distributive law is valid 
also, with the caution that attention must again be given to the dis¬ 
tinction between premultiplication and postmultiplication. Two cases 
are illustrated in the equations 

((2-HfB)xC = QxC-ffflxC 


[36] 

[37] 

[38] 

[39] 

[40] 

[41] 


[42] 
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and 

(? X (fl + 5B) = e X <J + (? X £B [43] 

It is useful to observe that since the rule for matrix multiplication 
agrees with that for the multiplication of determinants, the determinant 
of the multiple product 

(2xfflxex---x@ [44] 

has the value 

AXBXCX- -XG [45] 

5. Some special forms of square matrices 


A square matrix of the form 


3 ) = 


dll 

0 


0 

^22 


LO 0 


0-0 
0 • • • 0 


[46] 


in which all the elements are zero except those on the principal diagonal, 
is called a diagonal matrix. 

If, in addition, all the diagonal elements are unity, the matrix is re¬ 
ferred to as the Uentily or unit matrix. It is designated in this book by 
the special letter and has the appearance 


6 U = 


1 0 0 • • • 0 

0 1 0 ■ • • 0 

0 0 1 0 


0 0 0 ■ • • 1 


[47] 


If the matrix of the transformation 1 is the equations read 

Xi = >71 ' 

^2 = y2 ^ 


[48] 


*n = Jn J 


This set is referred to as the identity transformation, since the old 
variables Xi • • • and the new variables yi • • • yn are identical. Any 
matrix either pre- or postmultiplied by ^ is equal to itself. 

The unit matrix multiplied by a factor k becomes 


[k 

0 

0 • • 

• 0 

0 

k 

0 • • 

• 0 

0 

0 

k • • 

• 0 

0 

0 

0 • • 

• k 


[ 49 ] 
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This is called a scalar matrix because any matrix either pre~ or post- 
multiplied by is simply multiplied by the scalar factor k. 

When a matrix is multiplied by the diagonal matrix 2), Eq. 46, the 
results for pre- and postmultiplication differ in the following manner. 
The formation of 2) X Q has the effect of multiplying the rows of S by 
dll, ^ 22 , * • • dnn respectively, whereas in the formation of Q X 2) the 
columns of Q are so multiplied. 

A square matrix fl whose elements satisfy the conditions 

aj^i == aik [50] 

evidently possesses symmetry about its principal diagonal. It is, there¬ 
fore, called a symmetrical matrix. The elements on its principal diagonal 
are, of course, arbitrary. 

On the other hand, if the elements are subjected to the coriditions 

O'lci ~ [ 51 -] 

those on the principal diagonal must be zero. In this case the matrix is 
said to be skew symmetric. 

Interchanging rows and columns has no effect upon a symmetrical 
matrix, but in the case of a skew symmetrical matrix it amounts to mul¬ 
tiplying by the factor —1. It is, therefore, seen that if both (2 and ffi 
are symmetrical or both are skew symmetrical, Q X SB = SB X Q; that 
is, the matrix product is commutative in these special cases. 

6. Inverse, adjoint, transposed, reciprocal, and orthogonal 

MATRICES 

The rank of a square matrix of order n is equal to that of its determi¬ 
nant. When the rank is n, the determinant is not zero, and the matrix 
is said to be nonsingular. The matrix is singular if its rank is less than 
n, that is, if its determinant is zero. 

When the matrix Q of the transformation 1 is nonsingular the trans¬ 
formation may, according to the discussion of Arts. 8 and 9 of the previous 
chapter, be inverted to yield 

iwyi + ii23'2 d-h hmyn = 

hiyi + ^>22yi2 + • • * + h2nyn = ^2 


hniyi + K2y2 + • ' • + Knyn = Xn 
The matrix of this inverse transformation 

^12 ' * • ^In 

bo2 ' • ' b2n 
bfi2 * * ’ ^«nj 


bii 

£B= 



[53] 
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is referred to as the inverse of Q. This is written 

Q-* = S [54] 

The matrix Ct evidently does not possess an inverse when it is singular. 
It is dear that all matrices are singular in which the number of rows is 
not equal to the number of columns, because the system of equations 
represented by such matrices does not have unique solutions. A square 
matrix does not possess an inverse if its rank is less than its order. 

A few additional remarks are in order regarding the inversion of a 
linear transformation as viewed from the corresponding matrix equations. 
Writing the matrix equation for the transformation 1 

Qx] = y] [55] 

one is tempted to solve this for the matrix x] by simply dividing the 
equation through by (2. This form of solution is, however, meaningless 
without an interpretation of the operation of division by a matrix. 

Such an interpretation is arrived at if one observes first that the ele¬ 
ments of the inverse matrix S8, Eq. 53, are given by Eq. 48, Ch. I, which 
reads 

^ tS6] 

in which A^r are the cofactors of the determinant A corresponding to 
the matrix Q. The result expressed by Eq. 55, Ch. I, coupled with a 
recognition of the similarity between the processes of determinant multi¬ 
plication and matrix multiplication then shows that 

a X X Q = [57] 

that is, the product of a nonsingular matrix with its inverse equals the 
unit matrix, Eq. 47. Hence it becomes clear that the matrix equation 
55 is solved by premultiplying on both sides by (2~^, which gives 

^x] ^x]= [58] 

The operation of division by a matrix is, therefore, interpreted in terms 
of multiplication by means of the inverse matrix. 

Division by a matrix is subject to several restrictions. First of all, the 
matrix by which a matrix equation is to be divided must be nonsingular. 
Furthermore, in a matrix equation of the form 

Q X a X e - @ [59] 

it is not possible in a single step to divide out S so as to get a solution 
for (2 X C. 

To obtain this result, a more lengthy procedure such as the following 
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must be used. The equation may first be postmultiplied by 6“”^, giving 

fl X ffi = © X e-i [60] 

Next it is postmultiplied by It then reads 

G = @ X e-' X [61] 

Finally it is postmultiplied by C, giving the desired result 

Q X e = © X 6“^ X X e [62] 

The same result may alternatively be obtained by first premultiplying 
Eq. 59 by Q"”' so that it becomes 

a X (? = X § [63] 

then premultiplying by to obtain 

e = X 0"“^ X © [64] 

and finally premultiplying by fl so as to have 

G X C == G X X X © [65] 

It should be observed that obtaining the desired result in this case 
requires not only that be nonsingular, but also that either (? or C be 
nonsingular. If this additional condition is not met, the desired result 
cannot be obtained. 

Because of these restrictions on the process of division by a matrix, 
it is best not to use the term division at all. In matrix algebra pre- 
or postmultiplication by an inverse matrix is possible (if the given matrix 
is nonsingular), but the operation of division is said in general not to 
exist. 

By means of Eq, 56 the inverse of G may be written in the form 



The process of finding this inverse may be described as follows. First, 
each element in (2 is replaced by the quotient of its corresponding co¬ 
factor and the determinant of (3. Second, the rows and columns in this 
resulting matrix are interchanged. This procedure evidently involves 
a large amount of labor when the order of the given matij^!^|^h. 
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There are other methods by which the inverse of a matrix may be found. 
One of these, which is usuaJly considerably shorter than that stated here, 
is described in the next article. Additional methods are discussed in 
Art. 11. 

When the given matrix is of the diagonal form, Eq. 46, its inverse is 
also of the diagonal form and is given by 


9-1 = 


dll 1 




*22 


0 

0 


0 


0 

0 


d«n-'J 


[67] 


This result follows from the fact that all cofactors except those for the 
diagonal elements in 9 are zero, and these cofactors are 

Dkk — diid22 • • • dk-l,k-ldk+l,k+l • • • dnn [68] 

while the determinant of 9 is 


Hence 


D — diid22 • • • dnn 



1 


[69] 

[70] 


When A ^ is factored out of the inverse matrix Q i, Eq. 66, there is 
left 



^11 

A 21 * 

Anl 

AQ~^ = < 2 ® = 

Ai2 

A 22 • 

' An2 


_Ain 

A2n ’ 

Ann^ 


This matrix is called the adjoint of Q. Since the adjoint contains only 
the cofactors of the elements of Q, it may exist even when (2 is singular, 
but only if the rank of Q is not less than (w — 1) because all the cofactors 
would otherwise be zero. 

According to Eq. 55, Ch. I, the determinant of (2~i is A~^; that is, 
the inverse matrix has a determinant which is the inverse of that of the 
given matrix. It is clear from Eq. 71 that the adjoint matrix (2“ of order 
n has a determinant which is A" times that of Q~^. Hence the determinant 
of the adjoint is A"”*; that is. 

All A 21 • • • A„i 

Ai2 A 22 • • • A„2 


Ain A2n * * * Ann 


= A"-i [72] 


It follows that if the determinant of Q is not zero, the determinant of the 
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adjoint is not zero either, whereas if the determinant of d is zero, that of 
Q“ is zero also. 

Hence if (2 has the rank «, then (2“ also has the rank n; but if d has 
any rank less than (» — 1), the rank of Q“ is zero because all its elements 
are zero. When the rank of (2 is (« — 1), at least one of the elements of 
(2“ is not zero and, therefore, its rank is at least 1. It can be shown to be 
no greater than 1, as is further discussed in Art. 8 of Ch. III. 

The linear transformation 1 is for some piuposes more effectively 
studied when written in the schematic form 


[73] 


yn I ^n\ ^n2 ^n3 * * * ^nn 

which places the matrix more clearly in evidence. The Eqs. 1 are easily 
read out of this schematic arrangement by following along the rows and 
mentally dropping the x's down into their proper positions, supplying 
at the same time the necessary equal and plus signs. It now becomes 
more evident that these equations are closely related to another set, 
namely that which is obtained when the same manner of reading is 
carried out along the columns. Written out in the normal fashion, these 
equations are 

(^nyi + ^21^2 + • • • + dniyn = 

^I2yi + ^ 223^2 + * • • + Orn2yn = ^2 


O'lnyi + (l2ny2 H-H ^nnjn = 




Xi 

X2 

^3 • 

• • Xn 

yi 

^11 

ai2 

ai3 • 

' ‘ ^In 

y2 

^21 

^22 

0^23 * 

' * 

ys 

^31 

as2 

<3^33 • 

• * ^3n 


With reference to Eqs. 1, they are called the transposed set. Their 
matrix is 



Oil 

021 

• • • «nl 


ai2 

^22 

• • • fln2 



^2n 

• • • Onn_ 


[75] 


and is called the transpose (sometimes also the conjugate) of d. The 
transpose of (2 is the matrix (2 with its rows and columns interchanged. 

In this book the transposed matrix is designated by the subscript t 
and the adjoint by the superscript a, as in Eqs. 75 and 71. 

The transpose of a matrix evidently exists whether that matrix is 
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singular or not and also when the number of rows is different from the 
number of columns. In particular, the transpose of a row matrix is a 
column matrix, and vice versa; that is. 


and 


3Lt = *] 

[76] 

*]« = ^ 

[77] 


The transposed set of equations 74 should not be confused with the 
inverse set 52. For certain types of matrices the transpose and inverse 
arc the same, but not in general. 

In order for the inverse of a matrix to be equal to its transpose, the 
elements of tliat matrix must satisfy certain special conditions. It is easy 
to establish these conditions. If the elements of the matrix fi are ar«, 
those of the transpose are Ogry and the elements of the inverse matrix 
are given by Eq. 56. Hence the desired conditions are expressed by 


dgr = 



[78] 


The significance of this result may be made more evident by substitut¬ 
ing it into the relations expressed by Eqs. 45 and 46 of Ch. I. These 
equations, it is recalled, hold generally for the elements and cofactors 
of any determinant. Substituting Eq. 78 into Eq. 45 of Ch. I gives 

, , , f 1 for ^ 

+ • • • + aniUnk = j q {qx i jX k 

Substituting Eq. 78 into Eq. 46 of Ch. I yields the companion relation 
I II f 1 for % k rorfci 

+ ^ 12^*2 + • • • + aindkn = | q ^ 

Equation 79 states that the sum of the squares of the elements of any 
column equals unity, but that the sum of the products of the elements 
of any column with the corresponding ones of any other column is equal 
to zero. Equation 80 expresses a similar relation with regard to the ele¬ 
ments in the rows of the matrix. For example, 

aii^ + ^ 12 ^ . 4 - ain^ = 1 

or 

021 ^ + ^ 22 ^ + • • • + an2^ = 1 [ 81 ] 

but 

^11^21 + ^12^22 + • • • + ^ln^2n = 0 



AH.6i 


INVERSE AND OTHER RELATED MATRICES 


45 


at 


®12®13 *l" 022®23 “f" • * ■ + O’niO'nZ — 0 [82] 


and so forth. 

A matrix whose elements satisfy the relation 78, and hence the relations 
79 and 80 also, is called an orthogonal matrix. The term “ orthogonal ” 
suggests the existence of a right-angle relationship. The geometrical 
interpretation which justifies the name for this particular tyjje of matrix 
is given in the following chapter. A simple numerical illustration of an 
orthogonal matrix is 


a = 


0.5 0.5 

-0.707 0.707 
-0.5 -0.5 


0.707' 

0 

0.707 


[83] 


The determinant of the matrix (? is .4. The determinant of its transpose 
is also A, but since the transpose of an orthogonal matrix is equal to its 
inverse, the determinant of (i must at the same time be equal to 
Hence the determinant of an orthogonal matrix must satisfy the equation 



A^^ 

A 

[84] 

whence 


A^ = 1 

[85] 

and 


i4 = ±1 

[86] 


The conditions under which the algebraic sign is either plus or minus 
are discussed subsequently. For the matrix 83, the determinant is 4-1, 
as the reader may readily verify. 

The transpose of the inverse of a matrix plays a sufficiently important 
role in the subjects utilizing matrix algebra to justify for it a special 
name and designation. It is called the reciprocal matrix, and it is desig¬ 
nated by an asterisk affixed to the corresponding script letter. Thus the 
reciprocal of G is given by 

a* = Gr* [87] 

The elements of the reciprocal matrix are similarly designated by an 
asterisk placed on the elements a,s of Q. Reference to Eq. 66 shows that 
the elements of G* are given by 



[88] 
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The gamp result is obtained by calculation of the inverse of the trans¬ 
pose, so transposition and inversion are commutative. 

The following summary may be helpful at this point: 

For a given matrix (2 with elements ar„ determinant A, and co¬ 
factors Ar,‘- 

A r 

The inverse of Q is (2~* with elements —r and determinant A~^. 

A 

The adjoint of Q is (2“ with elements A^r and determinant 
The transpose of (2 is (2* with elements a,r and determinant A. 

The reciprocal of <2 is with elements a*,, = and determinant 

A 

A-^. 

If (2 is orthogonal, then fl, = (2“*, Or, = —y > and determinant ^4 = ± 1. 

Also (2* = Q; that is, an orthogonal matrix is its own reciprocal. 

In the manipulation of matrix equations it is sometimes useful to note 
that 

((2 X X (2, [89] 

that is, the transpose of a product is equal to the reversed product of the 
individually transposed matrices. This conclusion follows from the fact 
that the product ((2 X is formed by multiplying the rows of (2 by 
the columns of £B and then interchanging the rows and columns in the 
resulting matrix, which is the same as though the elements had been 
formed by multiplying the columns of £B (these are the rows of £B<) by 
the rows of (2 (these are the columns of (2<). For example, the (2,1)- 
element in the resultant matrix ((2 X S)( is formed from the first row 
in (2 and the second column in S; and the (2,l)-element in the resultant 
matrix X (2e is formed from the second row in (second column in 
3) and the first column in (2( (first row in (2), which are identical com¬ 
binations. 

This relationship may readily be ext^ded to multiple products. If 
(2x3 = 9 [90] 

then 

((2 X 3), = 8, = X Qt [91] 

Next if 

(2 X 3 X C = 9 X e [92] 

then 

«2 X 3 X = (9 X C), = e, X 9t = X 3j X (2t [93] 
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In general, 

(G X X e X • • • X 5?)* = £?< X • • • X Ce X SB* X Qt [94] 

The transpose of a multiple product is equal to the reversed product of 
the individually transposed matrices. 

A similar relationship also holds for the inverse of a matrix product. If 

Q X SB = e [95] 

then from the fact that 

e X e-* = su (unit matrix) [96] 

and 

Q X SB X SB~* X ^ [97] 

it is seen that 

[98] 

Hence 

(Q X SB)-‘ = SB-1 ^ Q-i [-ppj 

The inverse of a product is equal to the reversed product of the individual 
inverse matrices. 

The extension to multiple products follows as before, 

(G X SB X e X • • • X SP)-i = sp-i X • • • X X SB-i x g-i [loo] 

It is clear that all the matrices must be nonsingular in order for this 
relation to apply, but this fact does not mean that a multiple product 
involving singular matrices cannot in some cases have an inverse. For 
example, the component matrices in the following product are evidently 
singular because they are not square: 

[®24] X [ 642 ] = [<^ 22 ] [101] 

But the resultant matrix is square and may be nonsingular, in which 
case it possesses an inverse. The relation 99 is not applicable to the 
product in Eq. 101. 

Similar reasoning shows that an analogous relationship holds also for 
the adjoint of a product of two matrices 

(G X SB)“ = 6 B“ X G“ [102] 

as well as for the adjoint of a multiple product 

(G X X C X • • • X X • • • X 6 “ X £B“ X G“ [103] 

According to the definition (Eq. 87) of the reciprocal of a matrix, it 
follows from Eqs. 89 and 99 that 

(G X SB)* = G* X SB* 


[104] 
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The reciprocal of the product of two matrices is equal to the product 
{not reversed) of the individual reciprocals. The extension of this rule 
to multiple products evidently reads 

(Q X SB X e X • • • X iP)* = Q* X SB* X C* X • • • X S?* [105] 

The relations expressed by Eqs. 89 and 99 also show that if SP and S are 
orthogonal matrices, so that 

9*t = and [106] 

then 

(SP X a), = (SP X a)-» [107] 

Hence tke product of two orthogonal matrices is again orthogonal. 


1 . Submatrices or the partitioning of matrices 

In carrying out a matrix product, subdividing or partitioning the 
matrices into smaller components is sometimes convenient. In the 
following example 


e X SB 


dll 

dl2 

^13 

^21 

1 to 

1 

^23 

^31 

^32 

1 ^33 

,^41 

^42 

<3^43^ 


the so-called submatrices in (2 are 


= r®" 

L®21 


®31 ®32 

O 4 I a42_ 



■^1 

1 612 


X 

bn 

1 ^22 



M i 

1 ^32 



=: pl®! 

= r 

L«43j 


and in SB they are 

021 = [^3l] 022 •= [^32 

The matrix product, Eq. 108, may be written 


612 613 
622 ^^23, 


Q X ffi 


«11 «12 
_Of21 a22. 


]xh' H 

J LP21 P22J 


and evaluated as though the submatrices were ordinary elements except 
that the order in which they enter into the products formed by this 





Art.^ 


SUBMATRICES OR PARTITIONING OF MATRICES 


49 


evaluation process must be observed carefully. Such products of sub¬ 
matrices must, of course, subsequently be carried out by the same rule 
of matrix multiplication. 

When the original matrices are partitioned as is done in Eq. 108, 
the division of the columns of (2 into subgroups must be identical with 
the division of the rows of into subgroups. Thus the subgroup of the 
first r columns of (2 must be matched by a subgroup of the first r rows of 
ffi. This matching assures that all the submatrices appearing in the 
products formed during the subsequent evaluation of Eq. Ill will be 
conformable. 

If the total number of columns in (2 are subdivided into more than 
two subgroups, the rows of SB must be similarly subdivided. The rows of 
(2 and the columns of on the other hand, may be subdivided in any 
desired manner without affecting the conformability of submatrices later 
appearing in the evaluation process. In Eq. 108 the columns of the matrix 

may, for example, not be subdivided at all or they may be divided 
into three subgroups instead of two. 

It is an instructive exercise to show, by means of the relations 37, 
that the total operations of multiplication and of addition involved in 
the complete evaluation of a matrix product are independent of whether 
or how the component matrices are subdivided. This fact alone might be 
regarded as an indication that the present discussion is, for practical 
purposes, wholly irrelevant except that subdivision may be convenient 
in certain special cases. A somewhat different application of the principle 
of subdividing matrices is, however, very useful practically in the solution 
of a set of linear equations or in the inversion of a matrix. 

The subdivided matrix equation for a linear transformation is indicated 

by ^ 







Xi 


yi 


an 

ai2 

1 ^13 

• * * 


^'2 


y 2 


^21 

(I22 1 

1 ^23 

* • • ^2n 




ya 


^31 

^32 

1 

1 ^33 

1 

• • • ^3n 

X 

— 

[112] 


1 

(ln 2 1 

1 

! flnS 

• • • o„„_ 




Jn. 



Denoting the submatrices by 


pil 

U12 

«12 = 

ai 3 • 

• dlrPi 

U2I 

^22} 

JI22 • 

* ^2nJ 

U3I 

^32 

a22 == 

U33 • 

1 - 

s 

CO 





Jlnl 

^Tl2^ 


.^n3 * 

^nnj 


[ 113 ] 
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and 

one may write the transformation, Eq. 112, as 

«nfi + «i 2 f 2 = m 

«2lfl + «22^2 = V2 

A possible method of solution is the following. The second equation in 
the set 115 may be premultiplied by ^ 22 ^^ and solved for ^ 2 ? giving 

^2 = «22 ^^2 OC 22 

Substituting this into the first equation of set 115 gives 

(ail ““ « 12 « 22 ’’'a 2 l)fl = >7l — ai2a22""^’72 [117] 

from which 

fl = («U ~ «12«22“'^«2i)”’^(’ 71 — «12a22“’S2) [118] 

In a similar fashion one obtains the solution for £ 2 ? 

(2 = («22 Ol2l<Xii'^^ai2)~~^ (V2 «21«ll”Sl) [119] 



(2 


V2 = 


ya' 

LynJ 


[114] 


As is to be expected, this is simply Eq. 118 with the subscripts 1 and 2 
interchanged. 

Writing for brevity 


— («ii — «i2«22 ^<^ 21 ) 
O 2 = («22 ”■ «21«ii"”^ai2) 


[ 120 ] 


the inverse of the matrix Q in the transformation 112 is indicated by 


«r‘ : 

— ^1 ^ai2Ct22 


-1 

7 


[ 121 ] 


The inversion of a matrix of given order is thus reduced to the inversion 
of matrices of lower order. These are the submatrices an and a 22 , and the 
resultant matrices di and O 2 given by Eqs. 120. For an and a 2 a to be 
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nonsingular, they must have the same number of rows as columns. 
The matrix Q must, therefore, be subdivided to meet this condition, as 
is done in Eq. 112. Even then it may happen that an or ^22 is singular, 
but this situation can always be remedied by a rearrangement in the order 
of the original equations. 

The submatrices ai 2 and a 2 i do not need to be inverted. They may 
have any number of rows irrespective of the number of columns. The 
matrices Bi and 62 are evidently square and of the same order as an 
and a 22 respectively. The process is, therefore, always applicable pro¬ 
vided, of course, that (2 is nonsingular. 

When the matrix (2 has many rows and columns, an extension of the 
method may be developed which allows for further subdivision, or the 
present method may again be applied to some of the submatrices obtained 
from a preliminary subdivision. 

A numerical example may serve to illustrate the advantage of this 
method over the one suggested by Cramer's rule. Let the matrix be 

^2 3 ! ~4 1 

1-212 4 

a = - 

3 2 1-2 3 

^-2 11 3-1 

For the indicated subdivision, 

1 -0 ““”[^2 4] 


In this simple case the submatrices an and a 22 may be inverted by in¬ 
spection, giving 


an ^ = 

\V 2 

7Li 

-1 

-2J 

-sG a 

[124] 

Next in order is the determination of 



-1 1 

ai2«22 — y 

[1 

;]-[: a 

-,‘U aa 

[125] 

and 





_x 1 

a2iau = j 

■ 3 
.-2 


l■;[J -3 

[ 126 ] 
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Then 


«12«22 «21 - y 


iri7 -121 

"7L14 42J 

[127] 

«12 — y 

j-r:;]' 

ir -22 28' 

"7L -4 -35. 

] [128] 

whence 




II 

1 

I iri7 -121 _ 

1 7114 42J 

1 r-3 331 

7 L -7 -56j 

[129] 

- 

331“* 1 f— 56 

-561 7 


[130] 

and 





n ir-22 28‘ 

ij 7L -4 -35. 


[131] 


71-1 1 r 28 7' 

d “ 57 L -25 8. 


[132] 

Finally, 




. , 1 r 56 

-h ai2a22 

;3l ir-1 -101 
3 J ^ 7 L 14 I 4 J 

1 r58 -14" 
■“ 57 L 7 16. 

[133] 

and 




1 I 1 r 28 

-e, -57L_25 

a-r* i]= 

1 r-29 -12' 
57 L 32 27_ 

[134] 


When Eqs. 130, 132, 133, and 134 are put together according to the form 
indicated in Eq. 121, the desired inverse is found to be 



■-56 

-33 

58 

-14 

1 

7 

-3 

7 

16 

57 

-29 

-12 

28 

7 


32 

27 

-25 

8 


The student should obtain this same result by means of Cramer’s rule 
directly in order to appreciate how considerable a saving in labor is 
afforded by the use of submatrices. 

The matrix of Eqs. 112 may be manipulated in a variety of additional 
ways which yield slight modifications in the process of obtaining the same 
end result, but there is little point in further discussing this item here 
since the fundamental principle remains the same. 
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When, after subdivision, the given matrix has the form 

«= [o“ !J 

Eqs. 120 and 121 show that the inverse is given by 

Q_, fair' 0 1 

Lo «22-*J 

On the other hand, if 

^ = 0 =] 

the inversion of Eq. 115 shows that 



These simple examples are readily generalized, with the result 



«ll 

0 • 

• • 0 ■ 

a = 

0 

OC22 * 

• 0 


_o 

0 • 

■ ' 


then 



an ^ 

0 

• 0 


G-i = 

0 

«22 ^ ’ ■ 

0 



_() 

0 

<^nn 

-1 


“o • 

• • 0 

Ol\n 


Q = 

0 ■ 

* * ^2,n—1 

0 



_“nl ■ 

• • 0 

0 



then the inverse is given by 



'o 

• • • 0 



0 

. . . /v-1 

• ' • a n-l,2 

0 



... 0 

0 


[136] 

[137] 

[138] 

[139] 
that if 

[140] 

[141] 

[142] 

[143] 


8. The linear transformation of matrices 

In Art. 1 it is shown that if the variables yi ■■■ yn in the transformation 
1 are subjected to the further transformation 14, the matrix which com- 
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bines the two transformations into one is given by the matrix product 
expressed by Eq. 20. In this process the matrix d is said to be linearly 
transformed into the matrix C. 

The matrix by means of which the transformation of d is effected, 
may sometimes advantageously be thought of as the resultant of a 
multiple product of very simple component matrices; thus 

ffi = X • • • X SB 3 X S 2 X ffii [144] 

The transformation of d is then considered to be accomplished through 
the succession of a number of simpler transformations, the first of which 
is effected by Sj, the second by and so forth. 

A matrix may be transformed by postmultiplication as well as by 
premultiplication, in which case the matrix effecting the transformation is 
decomposed into components according to the order indicated by 

ffi = ffli X ffi 2 X ffia X * • • X ffln [145] 

Here SBi accomplishes the first simple transformation, £62 the second, 
and so forth. 

It is of interest to determine the simplest fundamental forms into 
which an arbitrary nonsingular matrix may be decomposed, and 
to interpret the individual transformations which they effect upon the 
form of a matrix d. They are called elementary transformations, and the 
matrices which produce them are the elementary transformation matrices. 
There are three types of elementary transformations, and, correspond¬ 
ingly, there are three fundamental types of so-called elementary trans¬ 
formation matrices. 

The first tyj)e of elementary transformation amounts to an interchange 
of any two rows or columns of the matrix Q. The second type is the addi¬ 
tion of the elements of a row or column to the corresponding elements of 
another row or column; and the third type is the multiplication of any 
row or column of d by an arbitrary nonzero factor. Each type of trans¬ 
formation may be effected through multiplying Cf by a corresponding 
type of transformation matrix. If the desired transformation is intended 
to affect the rows, d is />r<?multiplicd by the transformation matrix; if 
the columns are to be affected, d is />t?^toiultiplied by the transformation 
matrix. 

Each type of elementary transformation matrix is formed from the 
unit matrix Eq. 47, by performing upon it the same elementary 
transformation which the desired transformation matrix is intended to 
effect in the matrix d by means of pre- or postmultiplication. Thus ^ 
with its pt\i and 9 th rows (respectively columns) interchanged yields a 
transformation matrix (type 1 ) which, by means of pre- (respectively 
post-) multiplication, interchanges the />th and 9 th rows (respectively 
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columns) of Q. The matrix % with its 5 ’th row (respectively column) 
added to its pth. row (respectively column) yields the transformation 
matrix (type 2) which, by means of pre- (respectively post-) multiplica¬ 
tion, effects the addition of the elements of the yth row (respectively 
column) of (J to the corresponding elements of its pih row (respectively 
column). Finally, the matrix with its pih. row (respectively column) 
multiplied by a factor k yields a transformation matrix (t 3 ^e 3) which, 
by means of pre- (respectively post-) multiplication, multiplies the 
elements of the pih row (respectively column) of (2 by k. 

Observe that each type of elementary transformation matrix has two 
forms according to whether it is intended to effect a transformation of the 
rows or colmnns of (2 (by pre- or postmultij:Jfcation, respectively). The 
one form in each case is evidently the transpose of the other, and in types 
1 and 3 these two are readily seen to biddentical, whereas in type 2 the 
transposed matrix merely interchapg'es the distinction between the 
designations p and q in the description of the preceding paragraph. 

The elementarj' transformation matrices are in this text denoted by 
the script letter T with subscripts intended to indicate the t>'pe. Thus 
is used to designate type 1; Tp+g designates type 2 for the trans¬ 
formation of rows, whereas ‘Jp+g[ is the designation of this type for the 
transformation of columns; and denotes the transformation matrix 
of type 3. 

These are illustrated for the case of fourth-order matrices by the 
following examples: 


y 


1~3 — 



y 


2 - 1-31 — 


y 


3X* — 


0 

0 

1 

p 

1 

0 

0 

p 

‘1 

0 

0 

p 

'1 

0 

0 

0 


0 1 0 

1 0 0 

0 0 0 

0 0 1 . 

0 0 o' 

1 1 0 

0 1 0 

0 0 1 . 

0 0 0 ' 

1 0 0 

1 1 0 

0 0 1 . 

0 0 o' 

1 0 0 

0 ife 0 

0 0 1 


(3” 1 - 3)1 (type 1) [146] 


(3'2-h3|)i (type 2 for rows) [147] 


(y^)< (type 2 for columns) [148] 


3xic)t (type 3) 


[149] 



56 


MATRICES 


\Ck. II 


The transformation of a fourth-order matrix G by means of these is 
illustrated in the numerical examples given below; 



~0 

0 

1 

O' 


r 2 
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3 
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2 

6 
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3 ' i ^ 3 X (2 = 
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5ry-3XG = 

0 
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2 
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"1 
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O' 
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7 

3 

6' 
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9 
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1 
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0 

0 

= 

1] 

13 
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.10 

5 

3 

1 _ 


.10 

5 

3 


1 

J 


■ 2 

4 

3 

6' 


'1 

0 

0 

O' 


' 2 

4 

15 

6' 


G X ^ 3 X (!>) ~ 

1 

4 

5 

2 

8 

6 

7 

9 

X 

0 

0 

1 

0 

0 

5 

0 

0 


1 

4 

5 

2 

40 

30 

7 

9 



10 

5 

3 

1 


0 

0 

0 

1 


10 

5 

15 

1 



[150] 

[151] 

[152] 

[153] 

[154] 

[155] 


The transformation matrix of type 2 may be generalized from the 
form Tp+j to (with reference to either rows or columns), which 

allows the gth row or column to be subtracted from as well as added to the 
/)th row or column. It is useful to note that for this type 




[156] 

and since 


“ ^p±g\ 

[157] 

it follows that 


(^p±g)i ^g±p 

[158] 

and 




(^p±Ql)t = ^g±pi 

[159] 
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For the matrices of types 1 and 3 it is clear that 

[160] 

and 

^pyk)i ~ 

It is also useful to note the form of the inverse of each type of trans¬ 
formation matrix, thus 


T - T 

p~q p'^q 

[162] 

^P±Q~^ = JTpTg (row or column) 

[163] 

^PXk ^ ~ J^pXkT^ 

[164] 


According to Eqs. 160 and 162, the transpose of the matrix of type 1 
equals its inverse. This type of transformation matrix is therefore 
orthogonal. 

In the transformation of matrices it is useful to have a type of trans¬ 
formation matrix which effects the addition (or subtraction) of the 
/c-multiplied r/th row or column to (or from) the pth. row or column in a 
single operation. Such a matrix is evidently the following combination 
of types 2 and 3: 

T= T qyk~^ X 7 X SqXk [165] 


or 

^P±.kq\ “ ^QXk X ^p^q\ X ^qXk~^ [166] 


according to whether the rows are to be affected by premultiplication or 
the columns by postmultiplication, respectively. The matrix ^p^kq or 
^v±kq\ is formed from the unit matrix ^1 by adding (or subtracting) its 
A’-multiplied gth row or column to (or from) the />th row or column, 
respectively. It may be referred to as type 23. It has the properties 

(3*pi^)f = ^p±kq\ [167] 

^P±kq~^ ^^PTkq (row or column) [168] 


A numerical illustration of the use of this matrix is 
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[169] 


[170] 
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According to the theory of determinants, it is clear that the trans¬ 
formation matrices have determinants with the following values: 


(type 1) 

Tp^q = 

-I 


[171] 

(type 2) 


1 

(row or column) 

[172] 

(type 3) 

Tpxk — 

k 


[173] 

(type 23) T’pj.*, = 

1 

(row or column) 

[174] 


Hence transformation of the matrix (J by means of types 2 or 23 leaves 
the value of the determinant A unchanged; transformation by means of 
type 1 merely changes the algebraic sign of A ; and transformation by 
means of type 3 has the effect of multiplying the determinant A by the 
factor k. 

It should be observed that an elementary transformation matrix W 
is always square (has the same number of rows as columns), but (i need 
not be. However, the order of 7 must be so chosen that the matrices are 
conformable. If Q. is not square, the correct order of 7 is different in the 
cases of pre- and postmultiplication. 

The three types of elementary transformation with the matrices 
7p^q, Tpig, and 7py^ky if repeatedly applied to an arbitrary matrix (2, 
are capable of yielding the same end result as is expressed by the relation 

fP X Q X 2 = e [175] 

in which 7 and 2 are any nonsingular matrices. This is the same as saying 
that any nonsingular matrix such as or 2 can be represented as a 
product of suitably chosen elementary matrices of types 1, 2, and 3 
alone. 

9. Equivalence of matrices 

A matrix C which may be obtained from a matrix Q by means of a 
finite number of elementary transformations is said to be equivalent to G. 
The equivalence of matrices is evidently a mutual relationship, since the 
elementary transformations are nonsingular and hence reversible. Thus 
if (? can be obtained from Q by a succession of elementary transformations, 
it follows that Q can be regained by means of elementary transformations. 
The state of equivalence of two matrices Q and C may evidently be ex¬ 
pressed by Eq. 175, in which and 2 are arbitrary nonsingular matrices. 

It is important for later applications to recognize that equivalent 
matrices have the same rank. The truth of this statement may be seen to 
follow from the fact that the rank of a matrix depends upon properties 
of the corresponding determinant (the vanishing or nonvanishing of this 
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determinant and its minors), which, according to the theory of determi¬ 
nants, are not altered by the elementary transformations. 


10. Transformation of a square matrix to the diagonal form 
A square matrix possesses equivalent diagonal forms, any of which 
may be obtained through a linear transformation having the form of 
Eq. 175. Such a transformation may be written 

X a X a = 9 [176] 

3) being an equivalent diagonal form of S. 

The matrices 9 and S which accomplish the transformation can be 
formed from components of the combination type 23 alone (see Art. 8), 
in which case Q. and 3) have the same determinant. 

The detailed process is best shown by means of a numerical example. 
The one given in Art. 2, Ch. I, illustrating the numerical evaluation of a 
determinant, involves precisely the elementary transformations required 
here. The given matrix Q. may be assumed to have ihe determinant A 
expressed by Eq. 4, Ch. I. The matrix f? consists of components of the 
type ^p±kqy their formation being described in Art. 2, Ch. I, by steps 
1, 2, and 3. Since premultiplication is required by these transformations, 
the order of the components referring respectively to these steps reads 
from right to left, thus 
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Third step Second step First step 


Similarly, the matrix S is given by the product of components of the 
type their formation being described by steps 4, 5, and 6. Here 

postmultiplication is involved. Hence the order of the component matrices 
corresponding respectively to these steps reads from left to right. The 
desired matrix S is, therefore, given by 
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1_ 


0 

0 

1 


0 

0 

1 _ 


0 

0 



Fourth step Fifth step Sixth step 


[178] 


The transformation expressed by Eq. 176 reads 


■ 1 

0 

o’ 


’1 

3 

2" 


’1 

-3 

7l 

s 


’1 

0 

0 ’ 

-4 

1 

0 

X 

4 

2 

6 

X 

0 

1 

__ 1 

5 

= 

0 

-10 

0 

1 

4 

1 


3 

1 

7 


0 

0 



0 

0 

1 3 

T) J 


[179] 


The determinant A is equal to the product of the diagonal elements. 
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It is obvious that, by means of elementary transformations of the type 
l^his resultant diagonal matrix may be made to go over into the 
unit matrix of like order. 

It is also possible to transform a matrix Q to the diagonal form by pre¬ 
multiplication or postmultiplication alone. For example, after the matrix 
is reduced to the triangular fonn in the manner described above, one has 



1 

0 0 ‘ 


"1 3 2~ 


ri 3 2 i 

£P X <2 = 

-4 

1 

s 

1 0 
_ 4 1 

X 

4 2 6 

3 1 7 

■■ 

- 1 

o o 

T 

o 


The elements above the principal diagonal in this triangular matrix may 
now be reduced to zero by continuing the process of premultiplication 
with transformation matrices of the same type as the ones contained in 
^P, Eq. 177. Thus the fourth step may be the following: 


■] 

0 

-fa' 


"I 

3 

2‘ 


"1 

3 

0 " 

0 

1 

d 

X 

0 

-10 

-2 

= 

0 

-10 

-2 

0 

0 

1 _ 


0 

0 

1 3 

5 J 


0 

0 

1 3 

T'J 


The fifth step becomes 


’1 

0 

0 ■ 


”1 

3 

0 " 


’1 

3 

0 ■ 

0 

1 

1 0 

1 :r 

X 

0 

-10 

-2 

= 

0 

-10 

0 

0 

0 

1 _ 


0 

0 

la . 

5 . 


0 

0 

1 3 

6 J 


and the sixth and final step reads 


"1 


0" 


"1 

3 

0 ■ 


"1 

0 

0 ■ 

0 

1 

0 

X 

0 

-10 

0 

= 

0 

-10 

0 

0 

0 

1 


0 

0 

ii!. 

5 - 


0 

0 

la 

o -J 


[182] 


[183] 


The resultant transformation matrix combining the last three steps 
liecomes 



"1 

3 

1 (7 

0 ‘ 


"I 

0 

0 ■ 


"1 

0 

-ffl 


"1 


— 7 n 

1 .3 

— 

0 

1 

0 

X 

0 

1 

f [[ 

X 

0 

1 

0 

== 

0 

1 

1 0 
'1 3 


0 

0 

1 


0 

0 

1 _ 


0 

0 

1 _ 


0 

0 

1 _ 


Sixth step Fifth step Fourth step 


[184] 


wliich is, of course, different from the matrix 178, although not unlike 
this matrix in fonn. The complete transformation is accomplished by 
prcmultiplication of Cf by the resultant transformation matrix: 



'1 

3 

1 0 

7 " 
13 


1 

0 

0*" 

= a X O'* = 

0 

1 

1 0 
13 

X 

-4 

1 

0 


0 

0 

. 1, 


1 

5 

1 

5 

1^ 


4 

9.5 

_7 

1 3 

1 3 

1 3 

_ r> 0 

5 

1 0 

1 3 

13 

1 3 

X 

. 5 

_ . 1 . 

5 

1 


[ 185 ] 
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In place of the transformation expressed by Eq. 176, one now has 

X a = 3) [186] 


It should be clear that a similar procedure, involving postmultiplication 
only, can also be used to accomplish the same result. The reader may 
carry out the detailed steps as an exercise. 

In the above numerical example, the rank of the given matrix is equal 
to its order; that is, the matrix is nonsingular. When the rank of S is less 
than its order, some of the diagonal elements in 3) are found to be zero, 
but the method of transformation given in Eq. 176 is still applicable. 

From the definition of the rank of a square matrix (which is the same as 
the rank of its determinant) it is readily seen that if the rank of a matrix 
(1 of order n h r — {n — p), then p of the diagonal elements in 3) be¬ 
come zero. It is then possible to arrange the remaining elements so that 
3) has the appearance 


d\i 

0 

0 


0" 

0 

^22 

0 

.. . 

0 

0 

0 • 

. . 

drr • • • 

0 

0 

0 • 


0 0 • 

• • 0 

0 

0 



0 _ 


By a further transformajjon, the following form may be obtained: 


6 - 


10 0 
0 1 0 


0 0 • • • 1 
0 0 • • • 


0 

0 


... 0 
0 • • 0 


> r rows 


0 0 • • • 0 


[188] 


Since the matrix 3) is symmetric, it may be desirable to find 6 by a 
transformation of the form 6 = 3\3)t?. The matrix 3^ will not be real, 
however, if any of the diagonal elements in 3) are negative. The form of 
6 given by Eq. 188 may nevertheless be obtained using only real matrices 
either by pre- or postmultiplication alone, or by a transformation like 
Eq. 176 in which ^ and S need not be specially related. 

This diagonal matrix (in which the first r diagonal elements are unity 
and the rest zero) is referred to as the canonical form of the square matrix 
a of rank r. The diagonal and the canonical forms of a matrix obviously 
place its rank in evidence. 

A square matrix whose rank is less than its order is said to be de¬ 
generate. If the rank is r = (w — p), then p is spoken of as the degree of 
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degeneracy of the matrix or also as the nullity. The latter term is evi¬ 
dently suggested by the forms given by Eqs. 187 and 188. 

When the matrix (i is symmetrical, the matrix iP which enters the 
transformation to the diagonal according to the process indicated in 
Eq. 176 can evidently be equal to the transpose of S,* so that this equa¬ 
tion may be written 

X Q X a = a [i89] 


The matrix S can have a variety of forms, depending upon the values 
of the diagonal elements appearing in 9). For certain values, called the 
characteristic values or also the latent roots of the matrix G, the trans¬ 
formation matrix S in Eq. 189 becomes orthogonal. This orthogonal 
transformation is discussed in detail in the immediately following chap¬ 
ters, where it is also shown that the corresponding values of the diagonal 
elements in 9) are the roots of the so-called characteristic equation. 


Uhi ^12 * • * ^In 

^21 (<^22 * • • (hn 


Onl 


^n2 


(Onn-X) 


= 0 


[190] 


The left-hand side of this characteristic equation, which is formed by 
setting the determinant of the matrix Q — equal to zero, is evidently 
a polynomial in X of the ;?th degree. It is clear ^at the constant term in 
this equation (the term without X) is equal to the determinant of G. 
Moreover, the coefficient of the highest-power term is evidently ( — 1)^. 
If, then, Eq. 190 is divided through by ( — 1)’^, and if the n roots are 
Xi, X 2 , • • • X„, it follows from the theory of algebraic equations that 

^ = Xi X X 2 X • • • X Xn [191] 

The determinant of ® is, of course, also given by the product of the roots 
Xi, X 2 , • • • Xn, these being the diagonal elements in 9). This result .checks 
with the fact that the determinant of an orthogonal matrix is ±1 (see 
Eq. 86), so that the determinant of 9) in Eq. 189 is equal to the determi¬ 
nant of G. One thus recognizes the invariance of the determinant of a 
matrix to an orthogonal transformation of the form of Eq. 189. 

^It is significant that is not necessarily the transpose of 2. when G is symmetrical. Thus 
if the first operation upon the rows of G effects an interchange in any two rows, the matrix 
encountered at the next step i.s no longer symmetrical. Syljimetry can, of course, be restored 
by subsequently performing a similar operation upxin the corresponding columns, but such 
a step is not necessary, and if it is not taken the matrices 9^ and 2 ultimately obtained will 
obviously not be each other’s transpose. 




Art . ll] METHODS FOR OBTAINING INVERSE OF MATRIX 63 

11. Additional methods for obtaining the inverse of a matrix 

Having determined the matrices 9 and S which accomplish the 
reduction of a matrix Q to its equivalent diagonal form, according to 
Eq. 176, one may proceed to find the inverse of Q by means of the follow¬ 
ing reasoning. The first step is to form the inverse of both sides of Eq. 
176, making use of the property expressed by Eq. 100. This gives 

Q -\ ^ Q-i ^ g>-i ^ g)-i [-^92] 

Premultiplying by S and postmultiplying by fP, one has 

= 2 X 9)“^ X 9* [193] 

Inasmuch as the matrices 2 and 9* are already known, and the determina¬ 
tion of 9)~^ according to Eq. 67 is a relatively simple task, the formation 
of Q~^ by means of the result expressed by Eq. 193 involves only a nominal 
amount of additional computation. For the numerical example given in 
the preceding article (see Eqs. 177, 178, and 179) the Eq. 193 yields 

"1 -3 -I] ri 0 O] r 1 0 0" 

(2-1=0 1 -i X 0 0 X -4 10 

.0 0 ij Lo 0 L i 1- 

-4 9.5 -7" 

5 -0.5 -1 [194] 

1 -4 5j 

Alternatively one may begin with Eq. 186 and form its inverse, wliich 
reads 

Q-^ X = 9)“^ [195] 

Postmultiplication by 91 again gives the desired result, namely 

(r-‘ = 9r* X 91 [196] 

For the same numerical problem as discussed above (see Eq. 185) this 
reads 

ri 0 o] r-T^ 

(?-i= 0 -A 0 X A U 

Lo 0 L i 1 

-4 9.5 -7' 

5 -0.5 -1 [197] 

1 -4 5j 

If G is reduced to the diagonal form by postmultiplication alone, that 
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is, if one has found a matrix S such that 

(3 X § = 3) [198] 

then a similar manipulation as given above shows that 

= § X 9)*-' [199] 

Another method of matrix inversion, which in its essential steps utilizes 
the reasoning involved in the formation of the matrix (P in Eq. 177, is 
found to be exceptionally effective in numerical work.* The procedure is 
best described by considering the equivalent problem of solving a set of 
n simultaneous equations involving n unknowns, such as 


^ 11^1 + ^ 12^2 + • • • + dinXn = yi 
^21^1 + ^^22*^2 + • • • + a2n^n = ^2 


T Q'n2^2 -f~ * * * “j“ dnn^n — 


[ 200 ] 


Any other set of n equations which are linear combinations of these 
(called an equivalent set of equations) clearly has the same solutions. 
Since only the values of the coefficients a^k and those of the quantities 
yi * • • >'« are significant in the formation of such linear combinations, it 
is expedient to carryout the contemplated manipulations upon the matrix 


an 

U j o * 

^ In 

yi 

(Z2l 

022 • 

• • ^2n 

y2 

(hii 

On2 • ' 

^nn 

yn_ 


[ 201 ] 


which is the matrix Q of the set of Eqs. 200 with the quantities yi * • * y« 
included as an additional column. This resultant matrix involving n 
rows and w + 1 columns is referred to as the augmented matrix correspond¬ 
ing to the Eqs. 200. 

In order to simplify the notation in the following discussion it is 
effective to write the symbols ai,n+i, ^ 2 ,n+i, • • * ctn,n+i, in place of yi, 
y 2 > * • • ym so that the augmented matrix assumes the form 


’^11 

ai2 

• • ain 

6^1,71+1 

a2i 

^22 

• ' (^2n 

<^2,n~\-l 


^n2 ' 

^nn 



[ 202 ] 


The series of manipulations which are described presently, have for their 
objective the derivation of an equivalent set of equations having an 
augmented matrix in which all the elements of the principal diagonal 

*This method is described in a pape^* by Prescott D. Crout entitled: “ A Short Method for 
Evaluating Determinants and Solving Systems of Linear Equations with Real or Complex 
Coefficients,’^ A.I.E.E. Transactions^ Vol. 60, 1941, pp. 1235-1240. 
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are unity and all those below this diagonal are zero. It is readily appreci¬ 
ated that once this special set of equivalent equations is determined, the 
desired solutions may be written down by inspection. 

The first step is to divide the elements of the first row in the matrix 
202 by an so as to obtain 


1 

^12 

^13 


Uii 

an 

an 

<^21 

^22 

^23 * ■ 

’ * ^2.n-fl 


^n2 

^^n3 * ■ 

■ * an,n-\~l_ 


[203] 


This step requires that an have a nonzero value. If this condition is not 
fulfilled it can always be met by a rearrangement of the original equations. 
The fl 2 i-ii^ultiplied elements of the first row arc now subtracted from the 
corresponding elements of the second row, giving 


1 

a 12 

a 13 


an 

an 

^11 

0 

^22 

^23 

* * * 

^31 

^32 

^33 

* ’ • %,n+l 

^ani 

an2 

^n3 

• * * 


in which 


622 — ^22 


^ 21^12 

an 


^21<^13 

^23 ^23 

<2^11 


[205] 


, 021^1 .n+l 

02,n+l = ®2.n+l *“ 

an 

Next the asi-multiplied elements of the first row arc subtracted from the 
corresponding elements of the third row. This leaves the augmented 
matrix in the form 


1 

^12 

^13 

^l.n+1 

an 

an 

an 

0 

&22 

CO 

* ' * &2,n+l 

0 

^32 

^33 

• • * &3,nH-l 

.Onl 

an2 

(^n3 

• • • 


[ 206 ] 
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with 

0z2 — “32 - 

On 


^33 “ ^33- 

ail 


[207] 


^3,11+1 — ^3,tH-1 


ail 


The procedure is continued until the matrix assumes the form 


1 

^12 

^13 

^1,714-1 

ail 

an 

an 

0 

“^22 

CO 

• ^2,714-1 

0 

^32 

^33 • 

* • ^3,71-1-1 

_0 

bn2 

&7i3 * 

’ * ^ 71 , 714 - 1 ^ 


[208] 


A single formula for the coeflSicients h^k is recognized to be given by 


hsh = 


ail 


[209] 


Now the elements of the second row are divided by 622 - (A rearrange¬ 
ment of the last « — 1 rows will be required if 622 happens to be zero.) 
One then has 


1 

^12 

^13 

^1.71+1 


an 

an 

an 

0 

1 

^23 

62,714-1 



622 

0 

^32 

^33 • ‘ 

■ • ^3.n+l 

_o 

^712 

& 7 i 3 • ■ 

* 6n,n4-l. 


[ 210 ] 


The portion of this matrix exclusive of the first row and column is now 
dealt with in a manner which is identical with that just described for the 
transformation of the matrix 203 into the form of 208. In the first step 
the 632 -multiplied elements of the second row are subtracted from the 
corresponding ones of the third row. Next the 642 -multiplied elements of 
the second row are subtracted from the corresponding elements of the 
fourth row, and so on. This set of operations finally yields the matrix in 
the form 
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1 

^12 

<^13 

^14 


ail 

^11 

an 

ail 

0 

1 

CO j 

1 ^ 
Is 


022 

022 

622 

0 

0 

^33 

^^34 • 

‘ • ^3,n+l 

0 

0 

^43 

O44 * 


_0 

0 

0n3 

Cn 4 ■ ' 



in which the coefficients c,jt are given by the formula 

= 6 .* - ^ [ 212 ] 

022 

The portion of this matrix involving the coefficients is now treated 
in the same manner as described for the original matrix 202, and as 
repeated in the manipulation of that portion of the matrix 208 involving 
the coefficients 6,*. The resulting matrix then assumes the form 


^12 

^13 

^14 

^l.n +1 

an 

an 

^11 

an 

1 

CO 

^24 

^ 2 ,n-fl 

622 

^22 

622 

0 

1 

^34 

^3,n-fl 

^^33 

^33 

0 

0 

J 44 

• * • ^ 4 ,n 4 -l 

0 

j 

0 

dn4 

’ ’ dn,n-\-l, 

Ca^Czk 


dsk == Csk — 


The continuation of this process is obvious. In the case w = 4 , for 
example, one arrives at the desired form 


ai 2 

^13 

ai 4 


an 

an 

an 

an 

1 

f >23 

^24 

^25 

622 

622 

622 

0 

1 

^34 

^35 



Csz 


0 

0 

1 

d45 




^44 
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The solutions to the equivalent equations having this augmented matrix 
are easily recognized. They are given by 



^45 



X 4 , 

II 

^1 

1 




_ ^ 

^34 


00^ 


- X4, 



C33 




_ r) 

ho 4 


X2 

^22 

- X4 

d22 

i 

1 

1 


^15 

dl 4 

dr.i 

Xi 

=- 

- X4 

-- 

dll 

dll 

dll 


[216] 


^12 

ail 


^2 


In order to systematize the computational procedure it is expedient 
to record the following auxiliary matrix 


dll 

^2 

di:i 

dhi 

dl5 

dll 

dll 

dll 

dll 

d2l 

b22 

^^23 

622 

^24 

622 

^25 

^22 

d:ii 

^32 

^^33 

C 34 

<^33 

C35 

C‘S3 

dAi 

642 

Ca‘S 

^44 

1 

1 


[217] 


From the recursion formulas 209, 212, 214 which may be rewritten in 
the form 


— a^k 


Csk = ^8k 


dsk = <^8k — 


^s\^lk 

dll 

__ ^82^2fe 

dll 1)22 

ds\d\k ^ ^ 

dl 1 1)22 ^33 


[218] 


it becomes clear that the elements in the auxiliary matrix can be cal¬ 
culated and recorded in alphabetical sequence, with the recording of the 
elements of any column preceding that of the elements of the correspond¬ 
ing row. 
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Although only the elements above the principal diagonal are needed 
in the final computation of the unknowns, as is shown by the Eqs. 216, 
it is necessary to calculate and record also the elements on and below the 
principal diagonal since their values are needed in the sequence of com¬ 
putations which determine the auxiliary matrix as a whole. This fact is 
readily appreciated from an examination of the recursion formulas 218, 
or better still through an application of them to a numerical example. 

Since only those results arc recorded which are needed in subsequent 
calculations, the computational scheme is orderly and compact. It is 
also significant to mention that the calculation of any one of the elements 
of the auxiliary matrix, in the sequence described above, may be accom¬ 
plished through a single continuous operation on a modern computing 
machine. Thus, from the standpoint of minimizing the required opera¬ 
tions, the present procedure for solving simultaneous equations is excel¬ 
lently adapted to the available computing facilities. 

Regarding the problem of inverting the matrix of Eqs. 200 it is helpful 
to make the following preliminary observations. Suppose, in this system 
of equations, that all but one of the quantities Vi • • • Vn arc zero, and that 
the nonzero one, which may be any Vky has the value unity. The par¬ 
ticular .solution corresponding to this choice of y-values may conveniently 
be denoted by Xiky X 2 k, * * • Since the index k may have any value 
from 1 to n, there are n such sets of particular solutions. It should now be 
recognized that the set of j-values for = 1, when arranged in a column 
in which the order of numerical subscripts reads from top to bottom, 
represents the first column in the desired inverse matrix; the set for 
k = 2 represents the second column in the inverse matrix, and so forth. 
Thus the complete array of quantities x-sk are the elements of the 
inverse matrix, with the customary denotation of the indexes s and k. 
The process of determining the inverse matrix is thus seen to require 
the evaluation of n sets of simultaneous solutions. This process does not, 
however, require n times the computational labor involved in obtaining 
a single solution inasmuch as only the last column in the auxiliary matrix 
differs in the procedure for obtaining each solution. The work may be 
arranged so that all the n solutions are evaluated in one continuous 
sequence of operations by recording an auxiliary matrix with 7i varieties 
of “ last columns written side by side. The details of such a procedure 
are best illustrated by means of a numerical example. 

Choosing the same matrix as is used in the numerical illustrations of the 
preceding article, one begins by considering the following augmented 
matrix 

“1 3 2 1 0 O' 

4 2 6 0 1 0 

3 1 7 0 0 1 


[ 219 ] 
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in which the last three columns represent three varieties of the column of 
3 ^values as given in the matrix 201. The first of these three columns 
represents the values yi = 1, yj ■= ya = 0; for the second of the last three 
columns, ya = 1> yi = Js = 0; and for the third, ya = 1, yi = ya = 0. 
Regarding all the elements of this augmented matrix as coefficients a,k 
in the recursion formulas 218, one obtains the auxiliary matrix 


Tv 3 2 1 0 0 " 

\ 

_3 -8 V'viV A- 


[ 220 ] 


Only the element values above and to the right of the elements on the 
principal diagonal (beyond the dotted line) are now used to determine 
the values of the quantities x^k- The fourth, fifth, and sixth col umn s are 
regarded as “ last ” columns in computing values of x,k for ^ = 1, 2, 3 
respectively. For i = 1, one finds 


Xai m. — 

flJai ^ 0.4 ““ 0.2X31 ^ 


13 


Xii = 1 — 2*81 — 3*ai “ “ 7 ? 


£ 

13 


[ 221 ] 


For A — 2, 


and for k •= 3, 


*82 

1 «0-5 


Xja “ 0 2 xq 2 3x22 


9.5 

13 


[ 222 ] 


*88 *= 


13 


*28 = 0 — 0.2X33 ” ~ 13 


*13 = 0 — 2X33 — 3 X 23 = ~ 


13 


[ 223 ] 
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Hence the desired inverse matrix is 




^12 


_ 1 
” 13 

■-4 

9.5 

-7' 

Qr-^ = 

^21 

^22 

^23 

5 

-0.5 

-1 


.^31 

^32 

^33. 

1 

-4 

5 


which agrees with the results given by Eqs. 194 and 197. 


[224] 


PROBLEMS 

1. Write the following as a matrix equation: 

P = e\ix + + CdM 

For example, 

51=2X5-3X7+6X9+4X2 

2. Write the four scalar equations: 

=3^1 = >’2 ^ yz 3^4 

as a single matrix equation in at least four different ways. 

3. Express as matrix equations the relations: 




:_£L 

do's dxh 


and 






for 5 = 1, 2,3 and k 

4. Evaluate: 

and 


1,2,3. 


[2 3"''[ 1 9 [-2 7 ] 



’1 

6 

2*" 


' 2 

9 

-6’ 

6 

4 

3 

-5 

-4 

4 

-7 

10 


7 

-9 

1„ 


20 

8 

-5 


5 . Carry out the following triple product in two ways and note the difference in 
total numbers of multiplications and additions: 

‘ 1 
6 
-4 


r 3 2-16’ 

5-7 9 8 

L-4 10 6 2 


X 


3 

-9 

7 

11 


L-2 ij 


6. Evaluate: 


ri 1 n r 7 2 -lo” 

1 1 1 X -8 4 3 

[1 1 ij L 1 -6 7 


7 

2 

-10“ 

ri 

1 

1’ 

8 

4 

3 

X 1 

1 

1 

1 

-6 

7 

Li 

1 

1 


and 
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7. Given: 



“1 

0 

0 1 

”cos/3 

0 

—sin jST 

cosy 

sin 7 

0 " 

0 - 

0 

cos a 

sin a 6 == 

0 

1 

0 c - 

—sin 7 

cos 7 

0 


0 

—sin a 

cosaj 

.sin/3 

0 

cos 

0 

0 

1 


Show that these are orthogonal matrices. Also form the products ah^ ac^ hc^ and abc^ 
and show that they too are orthogonal. Note that ah 9 ^ ba, ac 9 ^ ca, etc. 

8 . In the evaluation of the following multiple product: 


j^~3j X [4 6 3] X |^-2j X [3 2] 

determine that association which requires the least number of multiplications and 
additions. 

9. Evaluate: 


2 

-6 4“ 


"a 0 0 “ 


"a 0 0 ” 


‘2 

-6 4“ 

3 

1 

9 7 

5 8 

X 

0 b 0 

0 0c 

and 

0 b 0 

0 

X 

3 

J 

9 7 

5 8 


10. Determine the most convenient ways of evaluating the following multiple 
products: 

[3 i]x[J 7]><[4 -i]x[ 5 ] 

[5 7)x[J i]x[J 5]x[‘ J] 

11. Evaluate: 

[la’ [la* [nr [nr 


”1 

0 

0 “ 


'1 

0 

0 " 

0 

2 

0 

X 

0 

0.5 

0 

0 

0 

5 


0 

0 

0.2 


12. Using the indicated partitioning, find the inverse of the following product: 


"2 

1 

6 

7 

1 

1 0 0 

1 

0 0 i 


‘-1 

3 

2 

-4 

0 

0 

0" 

0 

0 

0 1 

5 

4 

A 

0 

0 1 

1 5 

-2 

.0 

0 1 

3 

1_ 


0 

0 ; 

1 7 

~6. 


13. Given the nonsingular matrix: 



find the adjoint (?" and evaluate the products Q X G® and Q® X G. Repeat with the 
matrix: 
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Discuss the results, showing why their particular forms should be expected. 

14. Using the matrices Q of the preceding problem, determine matrices 9 and S 
which will yield diagonal forms in each of the following applicable relations: 

(i) X Q X S = 9 (ii) 9 X Q = 2) (iii) (2 X S = 9 

In terms of these results, find the inverse of the nonsingular matrix of Prob. 13. 

15. Given: 


“ 1 

2 

0 

-1 

4 

-3 

2 

1 

6 

2 

1 

4 

-3 

0 

5 

7 


find Q using the method of partitioning discussed in Art. 7, and again by the 
method involving the “ auxiliary matrix ” as discussed in Art. 11. 

16. Prove directly from the definitions of the sum and product of two matrices that 

a X (ffi X (?) = (Q X ffl) X e 

and 

a X (56 + e) = (a X 56) + (a X C) 

17. Compute the third power of the matrix 

1-12 1 “ 

~1 3 0 -3 

2 0 9 -6 

1 -3 -6 19^ 

and check the value 13824 of the determinant of the resultant matrix. 

18. If G is a nonsingular matrix, and the expression is interpreted as being 

equivalent to show that G"” is unique and, in particular, that 


1 

”1 

0 • ■ 

• o' 

II 

c 

0 

1 •• 

• 0 


_0 

0 •• 

' 1. 


19. The row matrix [I y 2 ys * • • yn] may be regarded as equivalent to a square 
matrix having these elements in its first row and zeros in the remaining rows. With 
this interpretation of the row matrix, show that 

[1 yi ys ••• yn]” = [1 yi ya y.] 

and more generally that 

[yi ya y.l” = yi"~‘[yi y2 • • • yj 



Analogously, find for the column matrix that 


"yi" 

m 

"yi" 

y2 


y2 

• 

II 

“■f 

• 
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20 . The expression 

P(SC) =Qo+Qi£C +a29C2 + ..- +Q,gC- 

in which Go, Qi, *' ’ ®n are matrix coefficients and 9C is a matrix playing the role of a 
variable, may be regarded as a matrix polynomial. A less general form of matric 
polynomial is 

e(£C) - + pSC -h + • • • + 

in which jfo, ^ i, * • • pn are scalar coefficients and ^ is a unit matrix having the same 
order as 

(a) Show that the equation 

GSC + ffl = 0 

in which SC, Q, and ® are matrices, has one solution only if Q is nonsingular. 

(b) In the equation 

QnSC'^ -h Gn-iST’*-^ -f • • • + Gi9C + Go = 0 

let 

SC ^[xi X 2 • ' • Xn] 

the coefficients G being matrices. Show that a solution is given by the expression 
9C = - -h Gn_ixi«-2 •+-•••+ Gi)-iGo 

provided the matrix in the parenthesis is nonsingular. 

(c) Consider the polynomial 

^ -sc^ + fflec +e 

with matrix coefficients, and 

gc = p“ H 

L *21 Xl 2 j 

Show that a solution to the equation ^ = 0 (null matrix) exists only if the following 
conditions are fulfilled 

xn^ -f X12PC21 4 - 4 - ^12^21 = -Cn 

(a^ii 4- X22 4 " ^11)3^12 4 " bi 2^22 = —C12 

(xii 4 - 01:22 4 - ^22)3^21 4 “ b 2 iXti = —C21 

X 22 ^' 4 - ^ 2 i:ri 2 4 - ^ 2 i:*^i 2 4 - ^22^22 == —^22 

and that the elements xn, X22, xu, X21 are independent only if 

20:11 + ^11 0:21 0:12 4 - ^>12 0 

^12 Xu 4 “ 0:22 + ^11 0 0:12 4- ^12 

0:21 4 - ^21 0 0:11 4- 3^22 4- ^22 0:21 

0 0:21 4- ^21 0:12 20:22 4 - f>22 

21. G and are two square matrices of like order whose product is zero, that is, 
G X ffi * 0 in which 0 is a null matrix of the same order as G or ffi. Let G be given 
and £B unknown. Write the complete set of equations whose solution (if it exists) 
yields the elements bik in terms of the elements aik. If G has the order n and the rank 
n, what is the solution? Discuss the possibility and form of solutions if G has the 
rank n — 1, and more generally if G has the rank n — p. 
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Solve the specific equations 

ri 5 n ri 5 r 

3 15 0xS=0 and £8x3 15 0-0 

[4 20 ij 20 

22. Given the equation 

gC2 + 39C - 10% = 0 

in which 9C is a square matrix and % is the imit matrix of like order. Find solutions 
of the form in which is a scalar and show that one may write the matrix 
polynomial in factored form 

(SC - jci%) X (2C - X2%) - 9C2 + 3gC ~ 10% 


Check this result for the particular value 



23. If C is a matrix with complex elements ah = aih jhih ^d if C has the 
conjugate elements, show that although C + C is real and C — C is imaginary, it 
does not follow in general that C X C is real nor that C X C = C X C. 



CHAPTER III 


Linear Transformations 

1 . Vector sets 

The primary object of this chapter is to offer a means of visualization 
for the purely algebraic reasoning underlying the essential ideas presented 
in Chs. I and II. This object is accomplished by giving a geometrical 
interpretation to the linear transformation and the matrix which charac¬ 
terizes it. There are, of course, a variety of possible forms which such a 
geometrical interpretation may take. The point of view given here is 
chosen for its utility in the particular applications discussed in the 
reference volumes. 

In order to keep the discussion fairly general initially, the matrix is 
assumed to have m rows and n columns instead of being square. It is 
written 


«ll 

a ] 2 * ' 

■ • O^ln 

^21 

a22 

■ ■ a^n J-JJ 

0 ml 

Om2 * 

Omn _ 


If the elements of each row are considered to be the components of a 
space vector with reference to a chosen rectangular Cartesian co-ordinate 
system, the matrix assumes an easily visualized geometrical characteriza¬ 
tion. It represents a set of vectors all emanating from a common origin so 
as to form a cluster. Since the number of components of each vector is in 
general greater than three, the process of visualization lacks the physical 
clarity which ordinarily accompanies the conception of a space vector. 
A purely mathematical extension of the idea of ordinary space to the 
conception of a space of many dimensions involves, however, only a pass¬ 
ing mental hazard. 

The co-ordinate axes in this many-dimensional space are for conven¬ 
ience numbered 1,2, 3, • • • etc., instead of being lettered x, y, s, as in the 
usual three-dimensional case. Thus the elements an, ai 2 , • • • ain of the 
first row of (i, for example, are looked upon as the components (projec¬ 
tions) of a vector ai with reference to the rectangular co-ordinate axes 
1, 2, • • • n in an w-dimensional space. In like manner, the elements a 2 i, 
0221 * * * ^ 2 n are looked upon as the components of a vector 02 - Finally, 
the elements of the wth row define a vector The cluster of vectors 
ai, a 2 , • • • Om is spoken of as the vector set of G. 

It is possible for the matrix G to be characterized by an alternative 
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vector set, namely the n vectors ax^ a 2 ^y • • * whose comp>onents are 
the elements taken by columns instead of by rows. In this case, the space 
occupied by the vectors is w-dimensional, because each vector now has m 
components. This cluster of vectors is called the transposed vector set of 
Q, since it is the vector set of the transix)se of (?. 


2. Linear DEPENDENCE AND independence; the rank of a vector 

SET 

If one or more of the vectors in a set can be expressed as a linear vector 
addition of the remaining vectors multii)lied by suitable positive or 
negative numerical factors, the set is said to be linearly dependent. If such 
an expression is not possible, the vectors are linearly independent. For a 
set of m vectors the possible existence of either condition may be ex¬ 
pressed mathematically by the statement that if one can not find m 
numbers 71, 72) * * * 7m (excluding the choice 7i = 72 ~ * * * = 7m = 0) 
for which the following vector equation holds 

7l^l + 72^2 + •••-!- ymO'rn = 0 [2] 

the vectors form an independent (otherwise a dependent) set. 

In three-dimensional space, any three vectors which do not lie in a 
plane form an independent set. If the three vectors do lie in a plane, one 
or more of them evidently can be expressed as a vector sum of the others 
multiplied by suitable factors. If in this same space the number of vectors 
is greater than three, the set must necessarily be dependent. In order for 
the vectors to form an independent set, it is necessary that their number 
shall not exceed three, although this condition alone is clearly not 
sufficient. 

In an w-dimensional space, the largest number of independent vectors 
is w, but a dependent set may contain any number of vectors. The num¬ 
ber of available dimensions in such a space is n. The vectors occupying 
this space may have such relative orientations that fewer than n dimen¬ 
sions are actually consumed or utilized. In three-dimensional space, for 
example, a set of vectors which lie in a plane consumes only two dimen¬ 
sions, and if they lie in a line they utilize only one of the available three 
dimensions. 

It is clear that if the number of dimensions utilized is less than the 
number of vectors in the set, the vectors are linearly dependent; but if the 
number of utilized dimensions equals the number of vectors (it obviously 
cannot be greater than the number of vectors in the set), the vectors are 
linearly independent. If the number of vectors is equal to or less than the 
number of available dimensions, both cases can occur; but if the number 
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of vectors is larger than the number of available dimensions, the only 
possibility is for the vector set to be a dependent one. 

The number of dimensions actually consumed by a vector set is by 
definition equal to the rank of that set. The vector set of fl, Eq. 1, con¬ 
sists of m vectors in an »-dimensional space. The rank of this set can at 
most be equal to n.llm > n, the vector set of (i must be dep)endent, for 
the rank is then necessarily less than the number of vectors. In order to 
determine the rank, one may begin by considering consecutively all 
groups of n vectors which can be selected from the given set (the number 
of such groups equals the number of combinations of tn things taken » at a 
time) and examining them to determine whether a linear relation of the 
form given by Eq. 2 can be found to exist. If one or more groups can be 
found for which such a relation does not exist, the rank is «; if it exists for 
all groups, the rank is less than n, and one must proceed to investigate 
in the same fashion all groups of (» — 1 ) vectors which can be selected 
from the given set. The largest number of independent vectors which can 
eventually be selected in this manner is equal to the rank of the vector 
set. 

In the light of the discussion in Art. 10 , Ch. I, regarding the rank of a 
determinant, the procedure just described may be seen to be equivalent 
to the following statements. From the matrix G (with w > »), aU the 
«-rowed determinants are selected. There are as many of these as there 
are m things taken « at a time, and they correspond to the groups of n 
vectors previously mentioned. The highest rank to be found among these 
determinants is the rank of a vector set of fl. 

In order to appreciate the truth of the latter assertion, it is necessary 
first to observe that the independence of (« — 1) vectors in an »-dimen- 
sional space may be established by consideration of all the “ projections ” 
of these vectors onto the n co-ordinate “planes,” comprising (» — 1 ) 
dimensions each. Such a “ projection ” is carried out by simply allowing 
the components of all the vectors along one particular axis of the space 
to go to zero, or be disregarded. Consideration of the problem of two 
vectors in three dimensions will lead to the recognition that a necessary 
and sufficient condition for independence of the (» — 1 ) vectors is that at 
least one of these n projected sets should be independent. Similarly, to 
insure dependence of the set, all the n projected sets must be dependent. 
In an identical manner the independence of (w — p) vectors in an n- 
dimensional space is determined by the independence of at least one of the 
group of all possible (n — />)-dimensional “ projections ” of the set, 
formed by striking out p components at a time from all the vectors. If, 
and only if, all such projected sets are dependent, the set itself is de¬ 
pendent. It is then pointed out that all possible groups of (n — p) vectors 
which can be formed from the original group of m may be regarded as 
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selected by choosing all possible groups of (n — p) vectors from each of 
the groups of n vectors originally selected. The process of ascertaining the 
highest rank among the n determinants first chosen is then seen to be 
exactly equivalent to finding the largest number of independent vectors 
in the set by a method of successive projections. 

In the transposed vector set of Q the number of vectors is n and the 
number of available dimensions is m. Still assuming m > n, the rank can 
at most be n, and is equal to the largest number of independent vectors 
which can be formed from the given set. The dependence or independence 
of a selected group of vectors is ascertained through noting whether or 
not a relation of the form given by Eq. 2 exists. This process of investiga¬ 
tion is, however, equivalent to determining the highest rank to be found 
among all determinants formed from the transpose of Q by selecting n 
columns in all possible combinations. These determinants are simply the 
transposed ones of those referred to in the preceding paragraph. Since the 
rank of a determinant is the same as that of its transpose, it therefore 
follows that the vector set of the transpose of Q has the same rank as the 
vector set of fl. 

The same conclusion holds when m <n and m — n. When m n, the 
rank of the vector set or its transpose is at most equal to the smaller of 
the numbers m and n. When m = n^ which is the case of greatest practical 
importance, the definition of the rank of the vector sets agrees with that 
already given for the rank of a square matrix and its determinant.* 

3. Vector significance of a linear transformation 

The ideas developed in the preceding articles suggest a useful geometri¬ 
cal interpretation for the linear transformation 

H-h ainXn = yi 1 

. [3] 

®nl*l + * • • + — yn j 

with the square matrix 



In the «-dimensional space occupied by the vector set of fl, two addi¬ 
tional vectors * and y, with components xi, X 2 , • • • x„ and yi, y 2 , • • ■ y„ 
respectively, are defined. The left-hand sides of the equations in the set 3 

•In connection with the discussion of this article it may be of interest also to refer to Art. 6, 
Ch. IV, for an alternative method for estabb'shing the linear dependence or independence of 
a given vector set. 
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are then recognized to be the scalar products of the vectors ^ 2 , • * • CLn 
respectively and the vector x. 

The scalar product (cf. Art. 2, Ch. V) is expressible either as the sum of 
the products of corresponding components of two vectors or as the product 
of their lengths and the cosine of the angle between them. If the given 
vectors are at right angles to each other, their scalar product is evidently 
zero. 

With the scalar product denoted by a dot placed between the symbols 
for the vectors (Gibbs’s notation), Eqs. 3 may be written in the alterna¬ 
tive compact form 


ax ‘ X Jy 
a2 • X = y2 


dn'Oe = yn 

These equations are said to transform a vector x into a vector y, the 
components of the latter being the scalar products of the vector x with 
those in the vector set of Ci. 

Any vector x with given length and direction is transformed into 
another vector y by means of Eqs. 5, the mechanism of the transforma¬ 
tion being determined by the cluster of vectors ai, (72, • • • an* As the 
length and direction of the vector x are varied at will, the length and 
direction of the vector y vary in a corresponding manner. The vectors 
X and y may be visualized as rods emanating from a box which contains 
the mechanism of the transformation as characterized by the matrix Q 
or its vector set. As the rod representing x is pulled out or pushed in and 
its direction changed, the mechanism in the box causes the rod represent¬ 
ing y to lengthen or shorten and change its direction in a corresponding 
manner. 

For the moment, the mechanism in the box may be assumed to be so 
constituted that each length and direction of the rod representing x 
uniquely determines a length and direction for the rod representing y. 
This is evidently the case if the matrix (2 is nonsingular. Then the trans¬ 
formation is reversible; that is, the rod representing y may be moved 
about at will, thus causing the mechanism in the box to produce corre¬ 
sponding lengths and directions for the rod x. A given point in space for 
the tip of the rod x determines one (and only one) point for the tip of the 
rod y, the corresponding points being independent of whether the rod x 
is pushed and the rod y caused to follow or vice versa.* 

•In particular it may be of interest to note that if the vector x is moved about in a plane, 
the vector y remains in a plane also; and if the tip of the a:-vector follows a straight line, the 
tip of the y-vector likewise follows a straight line. These matters arc treated in greater detail 
in the discussion immediately following Eq. 168 in Art. 10. 
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Viewed in this mechanical manner, the transformation 5 and its 
inverse involve the same mechanism. Algebraically, however, the inverse 
transformation 

hiyi H - 1- bmyn = xi ] 

. [ 6 ] 

bn\y\ ”1“ * ■ ' "b bfifiyn — Xji J 


written in vector form 

bi - y = xi 

bi -y - X2 


bn-y = Xn j 


[7] 


involves the vectors 
matrix 


6 i, 62 . • • • bn, which are the vector set of the inverse 


0-1 = £B = 


'bii 


hin 

J>nl 


' hnn^ 


[ 8 ] 


Since ffl X O equals the unit matrix, and is formed through multiplying 
the rows of SB by the columns of 0 , it follows that the scalar product 


bi • at' 


f 1 for i = ^ 
\ 0 for i 9^ k 


[9] 


The vectors ai\ a 2 ^ ••• a J are the transposed vector set of (?. More 
specifically, the relations 9 state that hi, for example, stands at right 
angles to the vectors a 2 \ whereas its scalar product with 

ajMs unity; 62 stands at right angles to the vectors ai\ • • • Un, and its 
scalar product with a 2 ^ is unity, and so forth. This situation offers an 
interesting geometrical view of the relation between a nonsingular matrix 
and its inverse. 

If the square matrix Q is symmetrical, 


ai^ = ai 
Q>2^ — (I 2 


[ 10 ] 


an^ = an j 

Then the orthogonal relationships just described hold directly for the 
vector set of G and the vector set of its inverse. 

4. Orthogonal CO-ORDINATE transformations; orthogonal vec¬ 
tor SETS 

It sometimes becomes necessary in dealing with physical problems to 
transform from one co-ordinate system to another. With respect to a 
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given reference system whose rectangular axes are numbered 1 , 2 , * • • 
the co-ordinates of a particular point may be denoted correspondingly 
by the quantities Xi, X2, • • • Xn- In a second rectangular reference system 
whose origin coincides with that of the given one, the axes which are 
labeled l', 2 ', • • • w' have different angular orientations with respect to 
the axes of the original system. This second reference system may be 
thought of as obtained by simply rotating the axes of the given system, 
keeping the origin fixed and maintaining the mutual orthogonality of the 
axes. 

The point in space whose projections on the original set of axes are the 
quantities Xi,X2r - • Xn has projections on the axes of the second reference 
system which are conveniently denoted by x\, x^2, • * * These are the 
co-ordinates of the same point with respect to the second reference 
system. The process of expressing the quantities x\^ x'2, • * • x\ in terms 
of x'l, X2, • • • Xn is spoken of as a co-ordinate transformation. 

In order for such a co-ordinate transformation to be carried out, the 
relative orientations of the axes in the original and the new reference 
systems must, of course, be known. Algebraically the directions of the 
new axes with respect to the old ones are expressed by quantities called 
direction cosines. If the cosines of the angles between axis and the 
axes 1 , 2 , • • • n are denoted respectively by the coefficients 011,012, • • • Oin, 
the cosines of the angles between axis 2 ' and the axes 1 , 2 , • • * n respec¬ 
tively by O21, 022i • • * 02ni and so forth, the array of coefficients in the 
matrix 



Oil 

O12 • ’ 

Oln 

e = 

O21 

O22 • 

' ' 02 n 


_ Onl 

On 2 * ‘ 

' * Onn 


are the complete set of direction cosines of the new axes with respect to 
the old ones. 

The desired co-ordinate transformation is then expressed by the linear 
set of equations 

0 \iXi -f- O12X2 + • • • -f OinXn •= x\ 

^ 21^1 + ^^ 22^2 -+-••• + 02n^n = ^^2 


^n\^l ”f~ ^n2^2 * “h Onr^n — X n 



In order to appreciate the correctness of this result with regard to its 
general form, and also to clarify the geometrical relations involved, the 
reader may carry through the derivation of this transformation for the 
simple two-dimensional case. 

In the language of the vector interpretation given in the preceding 
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article, Eqs. 12 transform a vector x with the components xi, ^C 2 , • • • 
into a vector a;' with the components x\^ x\^ • • • x\. Since the origin 
for both co-ordinate systems is the same and only one point in space is 
involved, x and x^ are the same vector. It has a different direction with 
respect to the new reference axes from that which it has with respect to 
the old axes, but its length must certainly be the same in both reference 
systems. This fact means that 

^ x\^ + + • • • + icV [13] 

The right-hand side of this equation may be obtained through mul¬ 
tiplying Eqs. 12 respectively by x\,x* 2 ^ * * • and adding. This process 
leads to a double summation. In order to abbreviate the writing of the 
result, it is effective to use the summation sign. Thus Eq. 13 with 12 sub¬ 
stituted becomes 

i =1:1:[14] 

«=»1 «=»1 r=l r^l 

Reversing the order of summation in the double sum yields 

Z { Z O.r*', ) Xr = T. XrXr [15] 

r=l \.=1 / r=l 

from which it becomes clear that the stipulation expressed by Eq. 13 
leads to the result 

n 

Z 0,rX', = Xr 

Written out for r = 1, 2, — • n, this reads 

Onx'i -f- 021X^2 + • • • + OnlX^n = 

Ol2x'l + 022 X ^2 On2x'n = ^2 ^ 

0\nX\ + 02nX^2 + ’ * * + OnnX^n = , 

This is the inverse transformation with respect to the one expressed by 
Eqs. 12. Its matrix is seen to be the transpose of 0. A matrix whose 
transpose is equal to its inverse is shown in Art. 6, Ch. II, to have the 
properties expressed by Eq. 78 or more specifically by Eqs. 79 and 80 of 
that chapter. 

The direction cosines of the new set of rectangular co-ordinate axes 
with respect to the old ones, therefore, satisfy the relations 

, , , / 1 for 5 = r 

OalOrl + 0g20r2 + * ’ ’ + 0,n0rn ” i Q lOT S T 

and 

OuOlr + 02802r + ’ * ‘ + OngOnr ” | Q for 5 f 


[16] 

[17] 
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In terms of the vector set of 0, that is, Oi, 02 , • • ■ o„ and the transposed 
vector set oi, 02 *, • • • 0n‘, these relations may be expressed by the scalar 


products 

_ / 1 
Ob' Or — ^ Q 

iox s — r 
for 5 5*^ r 

[20] 

and 


for 5 = r 
for s r 

[21] 


It thus becomes clear that the vector set of the matrix belonging to the 
transformation from one rectangular co-ordinate system to another con¬ 
sists of a cluster of mutually orthogonal vectors of unit length. The same is 
true of the transposed vector set, which also is the vector set of the inverse 
matrix. The reason for designating this kind of matrix as an orthogonal 
one is thus evident. The vectors likewise are said to form an orthogonal 
set. 

The relation 9, which is shown in the previous article to hold for the 
elements of any nonsingular matrix and those of its inverse, becomes 
identical with Eq. 21 when written for the elements of the orthogonal 
matrix and those of its inverse or transpose. 

As pointed out in the discussion of the orthogonal matrix, the product 

0 X 0t = 0 X 0“’ = [22] 

Since the determinant of the unit matrix is unity, and the determinant 
of 0t is the same as that of 0, it follows that 

02 = 1, or 0 = d=l [23] 

A closer examination of the geometry involved shows that the value of 
the determinant 0 is -|-1 if the directional sequence of the vectors 
0\, 02 , • • ■ On corresponds to a right-hand screw rule, and it is —1 if this 
sequence follows a left-hand screw rule. If both the reference axes 1, 
2, • • • », and l', 2', ■ • • n' form right-hand or both left-hand systems, 
O = -h 1; but if one is a right- and the other a left-hand system, O = — 1. 

Besides being the matrix of a transformation representing the rotation 
of a rectangular system of reference axes, the orthogonal matrix is 
evidently also the matrix of a transformation for which a vector x and its 
transform y have the same length. In other words, a linear transformation 
may represent either a change from one co-ordinate system to another or 
the transformation from one point in space to another with respect to the 
same reference system. If the transformation is an orthogonal one, it 
represents a pure rotation about the origin; that is, a rotation either of the 
co-ordinate system for a fixed point, or of an arbitrary point in a fixed 
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system. In either case, the axes of the reference system are at right angles 
to each other if the transformation is an orthogonal one. 

Such a rectangular co-ordinate system is commonly called a Cartesian 
system, though Descartes (after whom it is named) also devoted many 
of his studies to systems of co-ordinates in which the axes make oblique 
angles with each other. In a three-dimensional oblique reference system, 
the projection (co-ordinate) of a point on a given axis is found by dropping 
a line to this axis parallel to the plane of the other two axes (in a rectangu¬ 
lar reference system this line is the perpendicular dropped from the point 
in question). An analogous interpretation applies to oblique systems of 
more dimensions. 

Any linear nonsingular transformation may be regarded as a trans¬ 
formation of the co-ordinates of a point in a given oblique co-ordinate 
system to those of the same point in another system with coincident 
origin, or it may be regarded as the transformation from one point to 
another in the same oblique co-ordinate system. 

An oblique co-ordinate system is also called an affine system. The 
transformation from one such system to another or from one point to 
another in the same system is sometimes referred to as a linear affirm 
transformation. The orthogonal transformation is a special case of this 
more general type. 

5 . Transformation to an oblique co-ordinate system 

In the transformation from one orthogonal co-ordinate system to 
another, the direction cosines of the axes 1' with respect to the axes 
1, 2, • • • n (these are the elements of the first row of the matrix 0, Eq. 11) 
may be regarded as the components (projections) of a unit vector lying 
in the axis l'. This is the vector Oi of the vector set of 0. Similarly the 
vector 02 of this set is seen to be a unit vector emanating from the com¬ 
mon origin of the two orthogonal co-ordinate systems, coincident in 
direction with axis 2'. The vector set Oi, 02 ,' '' On of 0 is thus seen to be a 
set of coterminus unit vectors coincident respectively with the orthogonal 
axes of the system l', 2', • • • n!• By a similar line of reasoning, the trans¬ 
posed vector set Ox^ 02 ^ '' ' On is recognized as a set of coterminus unit 
vectors coincident respectively with the orthogonal axes of the co¬ 
ordinate system 1, 2, • • • w. 

This helpful visualization or geometrical interpretation of the co¬ 
efficients of a transformation matrix may be extended to the nonor- 
thogonal matrix associated with the transformation to an oblique 
(affine) co-ordinate system, but several novel features enter into the 
geometrical interpretations, requiring further detailed discussion. 

From the algebraic point of view, the number of dimensions of the 
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space under consideration is arbitrary, but for facilitating the geometrical 
visualization of the argument, reference is made to the two-dimensional 
Fig. 1. Here there are drawn three co-ordinate systems — one rectangular 
Cartesian system and two oblique systems. The axes of the rectangular 
system are designated by the letters Xi and X 2 . The first oblique system 
has the axes Si and S 2 , and the second oblique system has the axes S*i 



Fig. 1. The vector x described in equivalent fashion in oblique and rectangular 

co-ordinate systems. 

and S *2 which are at right angles to the axes S 2 and Si respectively of 
the first oblique system. The reason for considering the two oblique 
systems S and S* (with the relative orientations of axes as just described) 
in conjunction with the rectangular system X follows from the discussion 
below. 

For the rectangular co-ordinate system X, a set of unit vectors Wi, 
W 2 , • • • Wn is defined which emanate from the common origin O and are 
coincident respectively with the axes 1, 2, • • • w of this system, and hence 
are mutually at right angles with each other. A'vector x from O to P has 
projections on the axes 1, 2, • • • w which are denoted by Xi, rr 2 , • • • 
respectively. The vector components of this vector are UiXi , W 2 ^ 2 > * * • 

The vector sum of these components, according to the usual parallelogram 
(or parallelopiped) rule of vector addition, yields the vector jc, thus: 

[24] 


* = Mi*l + U 2 X 2 -i-1- Mn*n 
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In order to provide an equivalent representation for the vector x in 
the oblique system S, a set of unit vectors fli, ^ 2 , • • • is defined, which 
emanate from the common origin O and are coincident respectively with 
the axes 1, 2, • • • w of this oblique system. The projections of the vector x 
(co-ordinates of the point P) upon these oblique axes are denoted by 
fi, * fn respectively. The vector components of x in the oblique 
system H are, therefore, aiJi, a 2 f 2 > * * • and their vector sum also 
yields the vector x, that is, 

X = + ^2^2 + * * * + O'lXn [25] 

Finally, the vector x may also be represented in the second oblique 
system S* by defining for it the set of unit vectors a*i, a* 2 , • * • 
emanating from the common origin 0 and coinciding respectively with 
the axes 1, 2, • • • w of this system. The projections of x upon these axes 
are denoted respectively by f*i, f* 2 > * • • The vector components 
of X in the system S* are a* 2 f* 2 , * • * and their vector sum 

yields 

+ ^*2^*2 + • • • + [26] 


The unit vectors Wi, « 2 > * • * are regarded as the vector set of a matrix 



Un 

Ui2 • • 

• Wi, 

6U = 

^21 

U 22 * ’ 

• W 2 , 



Wn2 * * 

■ • «n: 


[27] 


in which the elements are the components of the vectors with respect to 
the rectangular co-ordinate system X. According to the definition of this 
vector set, it follows that this matrix is the unit matrix 


6U = 


1 0 0 
0 1 0 


0 0 


• 0 
■ 0 


1 


[28] 


The unit vectors ai, a 2 , • • • of the co-ordinate system E are regarded 
as the vector set of a matrix 



ail 

ai2 ' • 

• ^In 

a = 

^21 

a22 • * 

* a'2n 



an2 • * 

’ ^nn 


[29] 


in which the elements are the components of the vectors with respect to 
the rectangular system X also. For example, an, a^, • ■ ■ fli„ are the 
projections of the vector ai upon the axes 1, 2, • • • « respectively of the 
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system X \ ^21, ^22* ■ * * ^2n the projections of the vector ^2 up)on the 
axes 1, 2, • • • » respectively of the system X, and so forth. 

Similarly the unit vectors a*iy a* 2 » * • * of the co-ordinate system 
S* are regarded as the vector set of a matrix 



% 

0*12 • 


ct* = 

a* 2 i 

/l* 

a 22 

• a*2n 


_ 1 

a n2 



[30] 


in which the elements again are the components of the vectors with 
respect to the rectangular system X. That is, a^ny a*i 2 , • * * a*i, are the 
projections of the vector a*i upon the axes 1 , 2 , • • * n respectively of the 
system X\ a* 2 i, ^* 22 j • * • ^* 2 n are the projections of the vector < 1*2 upon 
the axes 1, 2, • • * w respectively of-the system X, and so forth. 

According to the definition of the systems H and H*, the axis 1 of S is 
orthogonal to the axes 2,3, • • • of E*; the axis 2 of E is orthogonal to the 
axes 1, 3, • * * « of E*, and so forth. Hence the scalar products of ai with 
the vectors a* 2 , ^* 3 , • • * are zero; the scalar products of the vector ^2 
with the vector a*i, a* 3 , • • • a*n are zero, etc. 

At this point a peculiarity of afiGine geometry (usually confusing to 
engineers) must be clearly understood. A distinction must be made be¬ 
tween the scale by means of which any length is measured and the scales 
which are attached to the oblique co-ordinate axes. The ‘‘ scale of 
length is that which is attached to the rectangular Cartesian cixes A*" 
(this is the same for all the axes 1, 2, • • • w in this system). The oblique 
axes carry their own scales but they are not used to measure length. 
The system E may in general have a different scale for each of its axes, 
and they are different from the scales which are used to lay off the units 
on the axes of the system E*. The unit vectors ai, ^ 2 ? • * • are units 
according to the scales for the axes of the E system, and the unit vectors 
^* 2 , • * * are units according to the scales for the axes of the S* 
system, but none of these unit vectors in general has unit length according to 
the “ scale of length,” which is the scale for the units laid off on the axes 
of the system X, 

The reader should appreciate that a scale on a co-ordinate axis may, 
in general, have a twofold purpose: 

(a) It may be used to determine the value of the projection of a px)int 
upon that axis. 

(b) It may be used as a tape measure is used to determine the distance 
between two points in space. 

A scale may be used for either purpose alone, or for both. Use (a) is 
the one with which the reader is undoubtedly most familiar in connection 
with his analytic work. For example, when plotting a function y = f{x), 
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scales are employed for the x- and y-axes which seldom have the same 
size of unit, and are used merely to read values of x and y, not also to 
measure length or distance. 

Interest in the measurement of length arises only when geometrical 
considerations enter into the problem. When they do, one must have a 

scale of length (tape measure) in addition to the various scales whose 
use is restricted to the determination of the values of projections. In the 
present problem the identical scales carried by the axes of the system X 
serve also for the measurement of length. This designation having been 
made, it is obvious that no other scales (except if they are identicid with 
those of the A'^-system) may be used for the measurement of length. 

For curvilinear co-ordinates the situation is even more confusing, since 
the scales which the co-ordinate axes bear not only are in general different 
for the different axes of the same system, but also vary from point to point 
along these axes, whereas the scale of length is independent of the co¬ 
ordinate system and independent of the location witLiu any system. As 
long as the oblique axes are linear, their scales are the same for all points 
within the system. 

The units for the scales carried by the axes of the oblique systems may 
have their lengths (as measured by the scale of the A"-system) so adjusted 
that the scalar products of the unit vectors < 2 i, 02 ^ • * * respectively with 
the unit vectors a*i, are all unity. (This adjustment is called 

“normalization.’’) For example, if the angle between ai and is ai, 
the lengths of ax and a*i (that is, \ai \ and |a*i|) are detennined so that 
kl X kM cos ai equals unity. Since ai is an arbitrary angle, it is clear 
that although the length of either ai or a*i can be chosen equal to unity, 
both unit vectors certainly cannot have unit length. 

As a result of this normalization process and the ort hogonality between 
unlike numbered axes in the systems S and E*, the sets of unit vectors 
in these systems satisfy the following conditions: 


ai' a — 


1 for i = k 
0 for i 9 ^ k 


[31] 


in which the scalar product is indicated by a dot. In terms of the matrices 
29 and 30 these conditions are expressed by the matrix eejuation 


an 

a 21 

ai2 • 

^22 • 

* a X n 

* a2n 

X 

■“a*ii 

a*i2 

a*2i 
a 22 

a jj 1 

a n2 


"1 

0 

0 

1 

• o O 

1- 

o o . 


a^2 ’ 

atm ^ 


* . 

/T* 

a 2n 

a* 

w n n _ 


0 

0 


Ij 


[32] 
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which is equivalent to 

a X = % [33] 

Hence it follows that 

a*t = a-^ or a* = [34] 

The matrix Q* is, therefore, the reciprocal of <?. The vector set a*i, 
a* 2 , • • • a*n is called the reciprocal of the set ai, 02 , • • • a„, and the oblique 
co-ordinate system 2* is referred to as the reciprocal of the oblique 
system 2. The present result yields a useful geometrical interpretation 
for the elements of a square matrix and those of its reciprocal. Inciden¬ 
tally, it may be recalled in this connection that an orthogonal matrix is 
its own reciprocal, and this coftclusion checks with the fact that an 
orthogonal co-ordinate system is also its own reciprocal. 

By use of one of the three equivalent relations for the vector x given by 
Eqs. 24, 25, and 26, the length of this vector may be expressed in terms 
of the co-ordinates of the rectangular system X, or of either of the oblique 
systems 2 or 2*. The square of this length is evidently given by the 
scalar product of the vector x with itself. Using Eq. 24, one has 

Ix |2 = x-x~ (Mj*i + U2X2 + • • • + UnXn ) 

■ "b ^2*2 + • * • + UnXn) [35] 

Because of the mutual orthogonality of the unit vectors, the scalar 
product of any vector with any other in the set is zero, whereas this 
product of any vector with itself is unity. Hence in terms of the co¬ 
ordinates of the rectangular system X, 

\x\^ = *1^ + *2^ d-b Xn^ [36] 

which is the familiar Pythagorean proposition extended to »-dimensional 
space. 

This result may be expressed in terms of the co-ordinates fi, { 2 , • • • 
of the vector x in the oblique system 2 by first determining the expres¬ 
sions for Xi, X 2 , • • • x„ in terms of the f’s, and then substituting these into 
Eq. 36. A general expression for the components Xi , X2 ,--- x„ is evidently 
given by 

Xk = Uk-x for ^=1,2, •••n' [37] 

which states that the projections of x on the axes 1, 2, • • • n of the system 
X are the scalar products of x with the unit vectors «i, « 2 , • • • Un of this 
system. 

Substituting Eq. 25 into Eq. 37 yields 


Xk — Uk‘ dlil -b Mit • ^2^2 + • • • + • flnfn 


[38] 
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But 


Ukai-= aik [ 39 ] 

because the scalar product of with ai equals the projection of the 
vector Ci upon axis k of the rectangular system A". Hence Eq. 38, written 
out for = 1, 2, • • • w, reads 


+ ^2li2 + • • * + ^nltn 
X2 = <^12^1 + ^22^2 + • • • + Un2fn 


= ^Inil + ^2nt2 + * * ' + O'nn^n 


[40] 


This set of equations may be written in matrix form by defining the 
column matrices 


*1 


*1 

X2 


a^nj 


[41] 


and 



[42] 


With the transpose of the matrix 29, Eqs. 40 evidently are expressed by 


x] = dt ^] 


[ 43 ] 


Substitution of this result into Eq. 36 is now greatly facilitated by 
noting that 


Xi 

X2 


x\^ = x\t X x] = [XiX 2 - • • Xn] X 


=- Xi^ + X2^ -\ - +Xn^ [44] 


a:»J 


Thus the square of the length of the vector x, expressed in terms of the 
co-ordinates of the oblique system S, becomes 

= {]t X ddt X «] 


[45] 
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fl? 


Here it is effective to let 

9 = a X C2< = 


Sn Si 2 ' 
g21 i22 • 


gin 

g2n 


gnl gn2 


gnnj 


[46] 


The elements of this matrix are evidently expressed by the scalar products 

gik ~ [ 47 ] 

from which it is clear that the matrix @ is symmetrical. 

Equation 45 may now be written out, as follows: 

lacp = gllil^ + gl2il^2 + * • • + gln^lin 
+ g2li2^1 + g22^2^ + ' • • + g2n^2^n 


+ g’nlfnfl + gn2^ni2 + • • ' + Snn^n^ [48] 

In the oblique system E, the squared length of the vector x is not simply 
equal to the sum of the squares of its components in that system, but the 
result expressed by Eq. 48 shows that all cross-product terms are present 
as welL Because of the symmetry of the S matrix, which is expressed by 

gik = gki [49] 

it is clear that all the cross-product terms in Eq. 48 occur twice. This 
fact makes possible some condensation of the form of Eq. 48. 

If all the scales for the axes of the S system are chosen equal to the 
scale of length (as can be and usually is done), the unit vectors Ui have 
unit length. It then follows that all the elements on the principal diagonal 
of the matrix @ become equal to unity. If the angle between the axes 
i and k in the S system is denoted by dik, the result in Eq. 47 shows that, 
for this choice of scales, the elements of 9 are given by the simple formula 

gik = cos 9ik [50] 

which yields unity for i = k. 

The determination of the matrix 9 is intimately connected with the 
choice of a scale in terms of which a length may be measured in the 
oblique co-ordinate system. Length in this system is defined by the matrix 
9. The latter is the matrix of the so-called fundamental metric tensor 
whose components are the elements gik- 

The present discussion should be recognized as fundamental to tensor 
algebra also, even though we are not concerned here with that closely 
related subject. Matrix equations and tensor equations, in fact, differ 
only in notation. The geometrical interpretations of them, as far as this 
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discusaon is concerned, are identical. Tensor notation is indeed some¬ 
what more advantageous than matrix notation for the operations now 
under consideration. The view taken in this book, however, is that 
matrix algebra is an invaluable aid to clear comprehension of the tensor 
method, and that the student will more readily assimilate that method 
once he has vmderstood the essential ideas underlying the present dis¬ 
cussion. Proper grasp of the tensor method comes not from the mere 
acquisition of a set of manipulative rules but rather from recognition that 
tensor algebra is a symbolic representation of geometrical and physical 
ideas. 

The square of the length of the vector x given by Eq. 36 may also be 
expressed in terms of the co-ordinates f* of the reciprocal oblique system 
S*. Thus, using Eq. 26, the co-ordinates of x in the rectangular system 
are, according to Eq. 37, given by 

Xk = Uk- a*iti + Uk ■ a*2(*2 H-+ «& • [51] 

Here it is recognized that the scalar product 

Uk ■ a*i = a*ik [52] 

so that Eq. 51 written out for ^ = 1,2, • • • m reads 

Xi = -f- a*2ii*2 + •' • + a*nl^*n 

*2 = O.* 12^*1 + ®*22f*2 + • • • + a*n2$*n 


X„ = a*In^* 1 + O'*2ni*2 + ' ’ * + 0*nn^*n 


[53] 


With the definition of the column matrix 


t] 




[54] 


and the transpose of the reciprocal matrix 30, Eqs. 53 are given in matrix 
form by 

^] = a*«f*] [55] 


Utilizing again the relation expressed by Eq. 44, the square of the length 
of the vector x in terms of the co-ordinates of the reciprocal oblique sys¬ 
tem reads 


\x\^ = £*], X a*Q*i X s*] 


[56] 
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Here it is effective to introduce the matrix 

g*n ^12 

§* = G* X = 


fin 

g*2n 


fil g*22 ■ • • 

_f nl ^n2 ■ * ' ^nn J 
The elements of this matrix are given by the scalar products 

fik = a*i ■ a*k = fki 

In view of Eqs. 34 and 46, it is recognized that 

= fir* X Q-' = (G X G,)~‘ = 9“‘ 


[57] 


[58] 

[59] 


The matrix which is fundamental to the measurement of length in 
the reciprocal oblique system, is the inverse of the matrix Hence 



[60] 


in which G is the determinant of 9, and its cofactors. Alternatively, 

[ 91 ] 

in which G* is the determinant of 9* and G*,* its cofactors. Evidently, 
by Eqs. 46 and 57, 

G = ^ [62] 

A representation for the elements fa similar in form to that given by 
Eq. 50 for ga is, according to Eq. 58, 

fik = k*il X |a*fc| cosff*it [63] 

in which |a*,| denotes the length of a unit vector in the reciprocal co- 
ordinate system E*, and 6*ik is the angle between the axes i and k in this 
system. 

In general, the lengths* of the unit vectors in the oblique systems are 
given by the expressions 


\ai\ = + ai2^ + • • 

• + o.n^ = VgJi 

[64] 

a*,| = V a*ii^ + a*i2^ + • 

-1- a*i„^ = Vf~i 

[65] 


•The term “ magnitude ” would actually be more appropriate here than “ length ” because 
the unit vectors a, and a*„ like those for the rectangular coordinates, are assumed to be 
without dimensions. 
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When the former axe diosen equal to uriity, the latter are in general all 
different from umty; that is, each axis of the S*" system carries a different 
scale. 

The result given by Eq. 56 for the square of the length of the vector x 
in terms of the co-ordinates of the reciprocal oblique system, when 
written out, reads 

kP = + g*12r"lf*2 + • • • + 

+ 2lf*2^*1 + ^ 22f*2^ + • • • + 2»{* 2f*n r^^-) 


+ + g*n2tn(*2 + ’ ' ' + g*nntn^ 

Again all cross-product terms (double products because g*tk — g*ki) are 
present in addition to the square terms. 

Still another form for \x\^ is possible if in Eq. 44 both of the alternative 
expressions 43 and 55 for x\ are substituted, one for .r]^ and the other 
for x\. Then the result reads 



= ^]t X X {*] 

[67] 

or 

kl" = e]i X Q*a, X $1 

[68] 

But by Eq. 33 

ax<i*t = a* xdt = 

[69] 

so that 

\x\^ = €]* X X f] 



= + ^2^*2 + • • • + ^ni*n 

[70] 


In this expression, no cross-product terms are present. It closely 
resembles the simple Pythagorean form given by Eq. 36, the only dif¬ 
ference being that products of corresponding components of the vector x 
in the two oblique systems appear in place of the squares of one kind of 
component. 

The ik are called the contravariant components and the {*a: the co- 
variant^ comp)onents of the vector x. The contravariant comp)onents 
are the components of x in the oblique system S, and the covariant com¬ 
ponents are those in the reciprocal system E*. Note in this connection 
that, for the two oblique co-ordinate systems, the property of being 

*These names are chosen with regard to the manner in which the components behave 
when subjected to a co-ordinate transformation. Thus the sets of variables and 

{*1 * * * are said to be contragrediml because when one set is subjected to a nonsingular 
linear transformation, the other is subjected to a linear transformation with the reciprocal 
matrix. For the moment, these matters need not be of interest, but they noay be demon- 
strated from Eqs. 92 and 97 which follow. 
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reciprocal is strictly a mutual one. Hence the {*jfe’s may just as well be 
looked upon as the contravariant components of in which case the 
become the covariant components. 

According to Eqs. 43 and 55, 

= Q*/€*3 [71] 

Hence, by Eqs. 34 and 46, 

= @j] = {*] [72] 

It is thus seen that the covariant and contravariant components of the 
vector X are related by the matrix 

Another interesting pair of relationships is obtained through forming 
the scalar products a* • x and a*k • x, using for x the Eqs. 26 and 25 
respectively, and noting the conditions 31. This procedure gives 

a* • a: = [73] 

and 

a*u-x = h [74] 

With reference to Fig. 1, <rjfc •» for ^ = 1 and 2 are the orthogonal 
projections OM and ON of the vector x upon the axes Ei and Sa. 
Equation 73 states that the lengths of these projections, measured with 
the scales of the Si and *2 axes, are numerically equal to the covariant 
components |*i and f *2 of x, and may be substituted for these in Eq. 70 
in evaluating the length of the vector x. Similarly, a*k • xiork — 1 and 2 
are the orthogonal projections OM* and ON* of the vector x upon the 
axes S*i and S* 2 - Equation 74 states that the lengths of these projections, 
measured with the scales of the S*i and S *2 axes, are numerically equal 
to the contravariant components ^i and of *. 

In view of the relation 73, the covariant components of the vector x 
are sometimes designated as the orthogonal projections of the point P in 
Fig. 1 upon the axes 1 and 2 of the system S (as contrasted with the 
parallel projections which are the contravariant components). Although 
this procedure is justified numerically, and does away with the necessity 
of considering the reciprocal axes (or drawing them in the case of a 
graphical determination), it fails to give the true geometrical picture 
regarding the nature of the covariant components. 

The scalar product of two vectors x and y in terms of their co-ordinates 
in an oblique system is readily determined with the aid of the above 
considerations. The components of y in the systems X, S, and S* may be 
denoted by v*,, ij*, and ri*k. The corresponding column matrices which 
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represent these components are 



The matrix Equations 43 and 55 written for * and y 

x] = Q,?] = a\n [76] 

y] = Q,,] = a*„*l [77] 

admit of four alternative representations for the scalar product 

x-y = x\tXy'] [78] 

They are 

«• y = f]t X X 7,] = t]e X @ X 7?] [79] 

= {*]* X Q*Q*t X 7,*] = {*], X @* X 7,*] [80] 

= kl X aa*, X 7,*] = k\m*] [si] 

= f]* X Q*Git X 7,] = r'],7,] [82] 

The first two of these results are similar in form to the Eqs. 48 and 66 
except that the terms are bilinear in ki and 7 ;* (respectively f*,- and ifk) 
instead of being quadratic in ki (respectively {*,). The last two are the 
mixed forms, which read 

X • y — kll]*! + k2V*2 + • • • + knn*n [83] 

X ■ y — k*ivi + k* 2 n 2 + ••• + ?* nVn [84] 

The first of these involves the contravariant components of x and the 
covariant components of y; in the second form these two types of com¬ 
ponents are interchanged. 

Except for the appearance of the two kinds of components, the ex¬ 
pressions 83 and 84 parallel the customary one in rectangular co-ordinates, 
namely 

x-y = xiyi + Xity-i + * • • + a:„y„ [85] 

In a rectangular (orthogonal) co-ordinate system, the covariant and 
contravariant components are identical, since the system is its own 
reciprocal. 

6. Transformation from one oblique system to another 

In addition to the oblique co-ordinate system characterized in terms 
of the rectangular system X by means of the matrix Q., a second oblique 
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system may be considered as characterized by a matrix with the set 
of unit vectors 

h]c = Uibki + « 2^*2 + • • • + u„bicr. (k = I, 2, • ■ • n) [86] 

The reciprocal of this second oblique system has the set of unit vectors 
b* k — Uib*kl + «2^**2 + • ■ ■ + Unb*kn (^ — Ij 2, • • •«) [87] 


which is the vector set of the reciprocal matrix S*, that is, 

h h* — ^ i = k 

" 0 iori^ k 


[ 88 ] 


The contravariant and covariant components of the vector x in the 
second oblique system are denoted by ft and f**, with the column 
matrices f] and f*]. Then the vector x, in terms of its components in the 
rectangular system X , has the following representations: 


*] = a,?] = Q*,f*] 
= £B,f] = 


[89] 


These relations readily yield the transformations from either of the 
variables or I** to either of the variables or associated with the 


second oblique system and its reciprocal. 

For example, from the matrix equation 

= s^f*] 

[90] 

premultiplication by 

SB = (SB*,)"* 

[91] 

gives 

X ^] = f*] 

[92] 


which relates the contravariant components of x in the first oblique 
system (these are the f*’s) to the covariant components of x in the seconfl 
oblique system. The resultant transformation matrix in this case is 

e = SB X <2, [93] 


If this is written out as 



Cll 

C12 ' • ' 

- ^In 

e = 

C21 

C22 * * 


with the vector 

_Cnl 

Cn 2 ' * 

■ 

Ck — UyCki + U 2 Ck 2 + 


+ UnCtn 

ik 


[94] 


n) [95] 
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then it is clear from Eq. 93 that the elements of C are given by the scalar 
products 

Cih = bi • ak [96] 

Hence the elements of the resultant transformation matrix in Eq. 92 
are seen to be the orthogonal projections of the unit vectors ak up)on the 
axes of the second oblique system (measured with the scales belonging to 
the axes of this system), or alternatively they may be considered as the 
projections of the unit vectors hk upon the axes of the first oblique 
system, measured with the corresponding scales carried by these axes. 

The transformation 92, with its resultant matrix determined as just 
described, transforms the contravariant components of oi; in the first 
system into covariant components in the second oblique system. 

Because of the mutual character of the relation between an oblique 
co-ordinate system and its inverse, as pointed out iif the previous article, 
Eq. 92 evidently remains true if SB is replaced by SB* and simultaneously 
f is replaced by f*. This shift gives 

X {] = r] [97] 

which is an equation relating the contravariant components of x in the 
first oblique system to the same kind of components in the second system. 
The elements of the resultant transformation matrix are determined and 
interpreted geometrically just as for the transformation 92 except that 
the reciprocal of the second oblique system with its unit vectors 6** 
replaces the unit vector bk with its corresponding axes. 

Further detailed discussion of these transformations becomes decidedly 
awkward in terms of matrix notation, as the reader can at this point 
readily appreciate by continuing the formation of various additional 
obvious relationships. Indeed, it is this circumstance which is the best 
justification for the introduction of the notation and the conventions of 
tensor algebra. The most important point in tliis notation lies in the 
designation of components in the reciprocal co-ordinate systems (co- 
variant quantities) by lower indexes (subscripts) and those in the given 
co-ordinate systems (contravariant quantities) by upper indexes (super¬ 
scripts) instead of by the placing of an asterisk on these quantities. 
The circumspection which results from this simple artifice alone may 
readily be appreciated even by the reader who has as yet no familiarity 
with the tensor notation. 

However, a detailed discussion of these matters at this point would 
lead the reader too far afield from the present objectives, which are to 
lay a general foundation for a more thorough consideration of this subject 
at a later time. 
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7. Systems of linear algebraic equations 


As a result of the geometrical interpretations given in the preceding 
articles the problem of finding solutions to a set of linear simultaneous 
algebraic equations may be discussed with a greater degree of clarity 
than is possible from a purely algebraic point of view. To start with, the 
number of equations is considered equal to the number of unknowns. 
The equations read 


+ ^3^12^2 + • * * + ^In^n = 

+ ^22^2 + • • • -f- a2nXn = >'2 

^nl^l ^n2^2 “H * * * “h ^nn^n ~ yn 

with the matrix 



ail 

ai2 ‘ * 

* ^In 

Q = 

^21 

a22 * • 

• ^-271 



^n2 ’ * 

• a„n_ 


[98] 


[99] 


The components aikj Xk, and jk of the vector set ai and the vectors x 
and y respectively for ^ = 1, 2, • • • n are the ordinary components with 
respect to a rectangular Cartesian co-ordinate system in an ^-dimensional 
space. 

The vector set ai (for i = 1, 2, • * • w) and the vector y are specified, 
and the problem is to find the corresponding vector x. The problem of 
particular interest according to the discussion in Art. 9, Ch. I, is the 
question whether a vector x can be found to satisfy the transformation 
98 when y is specified to be zero. In other words: Can the transform of a 
vector X be zero? 

In this case Eqs. 98 become homogeneous. In vector form they read 

ai • jc = 0 
a2-a; = 0 

an - X ^ 0 

According to these equations, the vector x (if one exists) must be simul¬ 
taneously orthogonal to all the vectors ai, a 2 , • • • an in the vector set of 3. 
The possibility of the existence of such a vector evidently depends upon 
the rank of this vector set. If the rank is n, then, according to the dis¬ 
cussion in Art. 2 above, the vector set utilizes all the available n dimen¬ 
sions, and it is clear that no vector x can be found to satisfy the conditions 
100. In this case the determinant of 3 is not zero. 

On the other hand, if the rank of the vector set of fl is (w ~ 1), one of 
the available n dimensions is left unoccupied. For example, if in three- 
dimensional space the vectors ai, a 2 , and as lie in a plane, only two dimen- 
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sions are utilized by this vector set, and any vector x normal to this plane 
constitutes a solution to the homogeneous Eqs. 100. The vanishing of the 
determinant of d is seen to l)e the necessary and sufficient condition for 
the existence of such a solution. 

At the same time it is also clear that the solution merely specifies a 
direction for the vector x\ its length is arbitrary. This checks with the 
conclusion reached in Art. 9, Ch. I, on purely algebraic grounds, according 
to which only the ratios of the unknowns Xi, X 2 j • • • Xn to each other are 
determined from the homogeneous equations. The direction cosines of 
the vector x are given by the expression 

_ Xk _ 

V aq'' + X2‘' + ‘ * * + X?i^ 

for ^ = 1, 2, • • • w, and this expression involves only the ratios of the 
unknowns. 

If the rank of the vector set of (i is (n — 2), twn of the available dimen¬ 
sions are left unoccupied. For example, if in three-dimensional space the 
vectors 02 , and aa lie in a straight line, any vector x lying in the plane 
normal to this line is simultaneously orthogonal to all three vectors in the 
set, and hence any such vector constitutes a solution. Although an 
infinite number of x-vectors may be drawn in this plane, only two inde¬ 
pendent ones can be found in this way. Hence wdien the rank of the matrix 
a is (« — 2), two independent solutions exist to the set of homogeneous 
Eqs. 100. 

In general, then, if the rank of Ct is {n — p), the homogeneous equations 
have p independent solutions. In any case, however, the length of the 
vector X for any of the solutions remains arbitrary; and if the rank of 
(3 is r < the equations determine only r of the Xk^ in terms of the 
remaining ones. Choosing arbitrary sets of values for these remaining 
XkS permits any number of solutions to be obtained, of which no more 
than p can be linearly independent. The .r-vectors corresponding to p 
independent solutions are in general not mutually orthogonal to each 
other, but a set of p mutually orthogonal solutions may be found by 
proceeding in the follow ing manner. 

If the vector set Oi, a 2 , • • • On has the rank r, it is surely possible to 
find r linearl}^ independent vectors in this set. The numbering in the 
original set may be changed if necessary so that the vectors ai, ^ 2 , • • • flr 
are the linearly independent ones. Then the r equations 

(lllXi + ^ 12:^2 + • • • + ainXn = 0 

+ ^22^2 (lonXn = 0 riOll 


Xk/ 




X 2 ^ 

'y d- 2 

xjr Xk 


I X-n 

Xk^ 


[ 101 ] 


Qr\Xl + flr 2^2 -j- • • • -f* arnXn = 0 
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uniquely detennine r of the *fc’s in terms of the remaining ones. That is, 
a set of values 

Xk = «ifc (for k = \,2, • • • n) [103] 

of which p = n — r are arbitrarily chosen (not more than p — I oi these 
may be chosen equal to zero, however) may be considered to be the 
components of the first a:-vector constituting a solution. This is the vector 
X = ai with the components ai*. 

Now the vector set ai ■ ■ • flr is augmented by having the vector o-i 
associated with it. This augmented set is surely an independent one, 
because ai is orthogonal to all the vectors Oi • • • a,. Hence the r + 1 
equations 

Cl 1*1 + Ci 2*2 + • • • + Cin*n = 0 


^rl^l “i“ ^r2^2 ~|“ * * * “1“ ^rn^n — ^ 

+ 0^12^2 + • • • + ainOCn == 0 

uniquely detennine r + 1 of the XkS in terms of the remaining ones. 
That is, a set of values 

= « 2 A: (for ^ = 1, 2, • • • «) [105] 

of which p — 1 are arbitrarily chosen (not more than p — 2oi these may 
be chosen equal to zero) represents the components of a vector x consti¬ 
tuting a second solution which is orthogonal to the augmented vector set 
ai • • * ar, «!, and hence orthogonal to the first solution x = ay. This 
second solution is the vector re = a 2 with the components a 2 k^ 

A third vector x with the components is found in like manner 
by solving the set of r + 2 homogeneous equations corresponding to the 
linearly independent vector set ai • • • ar, ai, a 2 . These solutions are the 
components 

Xk = oLzk (for k — 1, 2, • • • w) [106] 

of which — 2 are arbitrarily chosen. 

A continuation of this process finally yields a set of mutually orthogonal 
vectors ai, <x 2 y • • • all of which are orthogonal to all the vectors in the 
set ai, a 2 , • • • ar. Such a set of mutually orthogonal solutions is, however, 
not unique, because of the arbitrary choice of — 1, ^ — 2, etc., 
Xk-yolues at the various steps in the process of solution as described above. 

The case for which the rank of the vector set of Q is r = w — 1 is most 

frequent in its occurrence in practice. Here only one independent solution 

(direction for the a:-vector) exists. Because of the relation expressed by 
Eq. 46 of Ch. I and because of the fact that = 0 for r = m — 1, the 
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following relationship holds in this case (for all values of i and k from 
1 to ») 

dilAkl + + ’ ' ’ + ^in-^kn — 0 [107] 

in which A ks are the cofactors of the elements formed from the de¬ 
terminant A of the matrix Q. 

If Ak is defined as a vector having the components Akay the relation 
107 in vector form reads 

aiAk = 0 [108] 


which states that the vector Ak is simultaneously orthogonal to all the 
vectors in the set ai, <^ 2 , • • • This vector, therefore, constitutes the 
desired solution. 

Note that the cofactors Akn ior s — 1, • • • w are formed for the ele¬ 
ments of the ^th row of Ci, Any row may be chosen. If, however, all the 
cofactors of the elements of that row happen to be ^ero (as is possible 
because the rank is n — 1), the solution assumes an indeterminate form. 
However, since the rank is assumed for this case to be not less than n — I, 
a row can surely be found for which not all the cofactors of the elements 
are zero. 

The direction cosines of the vector x constituting the desired solution 
are given by 


cos 6 ^ 


__ 

Akl'^ + Ak2^ Akr? 


[109] 


in which 0^ is the angle between the direction of the vector x and the axis 
.s of the rectangular co-ordinate system. 

Another j)roblem of special interest in connection with Eqs. 98 occurs 
when the rank of the vector set of (i is less than w, but the yrvalues on 
the right-hand sides of these equations do not happen to be zero. That is, 
the equations are inhomogeneous but the determinant of their matrix is 
zero. In Art. 9, Ch. I, it is pointed out that solutions may still exist if the 
yiS have values satisfying Eq. 56, which reads 

yi — OLiCii -f- a 2 (li 2 + '••-[- OCndin (^ = 1, 2, - • • w) [HO] 

but that the solutions assume an indeterminate form when expressed 
according to Cramer’s rule. 

The otkS in Eq. 110 are arbitrary factors. In vector form this equation 
reads 

y = aiai -f a2(l2^ + * • • + [Hi] 

and states that the vector y is given by a linear combination of the 
transposed vector set of (i. By making use of the relations 110, Eqs. 98 
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may be rewritten in the form 



2 + * * ' “t“ n — 0 

+ • • • + = 0 

[112] 


1 ^n2^ 2 "1“ * * * "i” n “ 0 


in which 

1 

II 

[113] 

Or if «!, <* 2 , • 
and x' i, x' 2 , ■ • 

• • an are considered to 'be the components of a vector a, 
• x'n the components of a vector x', 


x' = X — a and * = *' + a [114] 


The vector x' is a solution to the homogeneous equations 112. The 
problem of finding solutions x' when the rank of (2 is r < « is discussed 
above, and the desired values of the vector x are given in terms of those 
for x' by Eq. 114. 

When the vector y, in this t 3 q)e of problem (for which r < n), cannot 
be expressed in the form of Eq. Ill (in this case y is not a member* of 
the transposed vector set of (2), the original set, Eqs. 98, is said to be 
inconsistent, and no solutions are possible. 

It is interesting that the discussion of this special problem incidentally 
offers also an alternative interpretation to the solution of the general 
inhomogeneous equations 98. This case is contained in the solutions to 
the homogeneous equations 1 12 for x' when the rank of (2 is n. Then the 
application of Cramer’s rule yields x' — 0-, that is, x'i = x '2 = ■ ■ • x'n = 
0, and the desired solution for x follows from Eq. 114, namely, for r — n^ 

x = a [115] 

In this case, Eq. Ill yields the following representation for the vector y: 

y = xiai‘+ 3 : 302 'd-+ [116] 

which is an interesting alternative form for the linear nonsingular trans¬ 
formation. 

It appears from this discussion that the necessary and sufficient con¬ 
dition for the existence of solutions to the inhomogeneous equations 98 
is that the vector y be a member of the transposed vector set Oi', 03 ', 

• • • o„‘, regardless of the rank of (2. If the rank is n, then y must neces¬ 
sarily be a member of the transposed vector set (no matter what the 
values of yi • • • yn may be) because the rank of the augmented set 
® 2 ^ • • • o„', y cannot be greater than n (see footnote below). Then 

*If the rank of the transposed vector set and of that set augmented by the vector y are 
alike, then y is called a member of the transposed vector set, and hence is expressible in the 
form given by Eq. 111. 
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there exists a unique solution for x which is given by Cramer’s rule. 
When the rank of (2 is less than w, no solutions exist unless y is a member 
of the transposed vector set of Q, in which case n — r linearly independent 
solutions can be found. 

A summary statement regarding the possibility of finding solutions to 
Eqs. 98, known as the rule of alternatives, may now be formulated, as 
follows: 

Either the matrix (2 of Eqs. 98 has the rank n, whence A 9 ^ 0, and 
there exists one set of values Xi, X 2 ^ • * * Xn which satisfies the equa¬ 
tions for arbitrary values of yi, ^ 2 ? * * * yn — in particular the trivial 
values Xi — X 2 — ' ‘ — Xn ^ 0 resulting for yj = yg = • • • = 

yn = 0— these solutions being given by Cramer’s rule, 

or the matrix (2 has the rank r = n — p {p 9 ^ 0), whence A = 0, and 
the corresponding homogeneous equations have p independent 
solutions. The inhomogeneous equations then have solutions for 
particular values of yi, y 2 , * • * yn only, namely those values for which 
the vector y is expressible as a linear combination of the transposed 
vector set of (2. To these particular solutions may be added those for 
the corresponding homogeneous system. 

The more general case of m equations with n unknowns 

^11^1 + ^12^2 -f • • • -b ainXn — Ji 

0^21^1 ^ 22^2 “b • * • ~f“ a2nXn ~ ^2 7 I 


“f" ^m2^2 -b * • * “b a»n%nXn — ym 

may now readily be disposed of. Multiplying the equations respectively 
by the unit vectors associated with the m axes of a rec¬ 

tangular co-ordinate system, and adding, yields the result 

y = Xiai^ + X 2 a 2 ^ + • • • + Xnan^ [118] 

where 

y = uiyi + U 2 y 2 + * • * + Umym [119] 

and 

aif == UiOik + U2a2k H-+ Umamk [120] 

are the vectors in the transposed set of the matrix (2 of Eqs. 117. 

The result given by Eq. 118 states that for any set of values Xi, X 2 , 
• • • Xn which simultaneously satisfies the m equations 117, the vector y 
is a member of the transposed vector set of G. In other words, unless y 
is a member of this vector set no solutions are possible, regardless of the 
rank of the set. This condition, which is arrived at above for the special 
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case w = n, is thus seen also to be the condition for the existence of solu¬ 
tions in the more general case m 7 ^ n. 

When m 9 ^ n this condition is more significant, for if the rank is n 
and m = n, the condition 118 is automatically fulfilled; whereas when 
m > n, for example, and the rank is n, y may or may not be a member 
of the transposed vector set. In other words, when w = « and the rank 
is n, there is no question about the existence of solutions to the inhomo¬ 
geneous equations; but when m 9 ^ n and the rank is n{<m) or m{<n), 
the existence of solutions still depends upon the fulfillment of the con¬ 
dition 118. 

If tliis condition is written 

y = aiffl* -f- <*2^2* "!■••• + ot-nfl'n [121] 

and ai, 02 , • ■ • a„ are regarded as the components of a vector a, then by 
letting 

x' = X ~ a X x' + a [122] 

as in the problem for m — n, the question of solutions to Eqs. 117 may 
be discussed for the inhomogeneous and the homogeneous cases simul¬ 
taneously, because the resulting equations 

dlix'I -h (liix '2 -f- • • • -h n ~ 0 

^21^ 1 d* (^22^ 2 “h * ’ * “h ^2n^ n ~ H Tl 0 


1 ~1“ ^m2^ 2 "1” * * * ”1” ^mn^- n — H 

apply to the inhomogeneous equations 117 for a 7 ^ 0 and to the corre¬ 
sponding homogeneous equations for a = 0. 

As discussed in Art. 2 of this chapter, the rank of the nonsquare matrix 
Q. of this set of equations is at most equal to the smaller of the two 
numbers m and n. lim > n, then r ^ n. Out of the m equations 123 it is 
possible to select r independent ones (the coefficients of these define r 
independent vectors in the vector set of (2). For these equations, n — r 
independent solutions x' may be found by the procedure discussed for the 
case m = n and r ^ n. In particular, for r = » only the trivial solution 
x' = 0 exists, which yields x = a. The solutions so found automatically 
satisfy the remaining m — r equations in the set 123 because the coeffi¬ 
cients of these equations are the components of those vectors in the vector 
set of Q. which are linear combinations of the others. 

When m < n, then r ^ m. Equations 123 then yield n — r independent 
solutions which again are found as for the case m = n and r ^ w. In 
particular, ior r = m there are n — m independent solutions. 
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8. On the bank of matrices having a null product 

If Q and S are two square matrices of order «, their product 

e = (2 X S [124] 

is also a square matrix of order n with coefficients given by the scalar 
products 

= a,- • Jfc' [125] 

in which Cj, 02> • * • On is the vector set of Q and bi\ 62*, •• - bn is the trans¬ 
posed vector set of £B. 

All the vectors a,- can be orthogonal to the vectors in which case 
all the coefficients Ca are zero. It thus becomes clear that the matrix 
product (2 X may be zero even though neither (2 nor fB is zero. This is 
an important difference between the laws of matrix algebra and those of 
scalar algebra, according to which the relation ab = 0 requires that 
either a or 5 be zero. 

The vector interpretation of Eq. 125 allows the following conclusions 
to be drawn when C = 0; 

(a) If (2 is of rank n, then fB must have the rank zero; that is, in this 
case fB = 0. 

(b) If neither (2 nor fB is zero, then the rank of both must be less than 
n. 

The first of these conclusions follows from the consideration that if the 
vector set a, has the rank n (occupies all the available dimensions) no 
vector exists which is simultaneously orthogonal to all the vectors a,; 
that is, b^ = 0. In order that any vectors b^ may exist, the vector set a, 
must evidently have a rank less than «, and conversely the rank of the 
vector set bk must be less than n in order that any nonzero a,- vectors 
may fulfill the condition a, ■ hk = 0. 

If the null condition 

bk = 0 [126] 

be compared with the system of homogeneous equations 

fli • X = 0 [127] 

the discussion of the previous article yields the conclusion that if the rank 
of the matrix (2 is ra ^ w, then n — ta independent vectors 6*' exist which 
fulfill the null condition, and hence the rank r\, of the matrix fB may be as 
large as but no larger than n — ta, that is, rb ^ n — ta. Thus if 

G X fB = 0 


[ 128 ] 
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then 


ra-\-n^n 


[I29J 


in which Q and are square matrices of order « with the ranks and 
fb respectively. 

It should be observed that the converse of this statement is not neces¬ 
sarily true, nor does it follow that the reversed product is zero when 
is zero. 

An interesting application of this result is found in considering the 
product of a matrix (i and its adjoint (i“. From the definition of the 
adjoint matrix (see Art. 6, Ch. II) and determinant theory (see spe¬ 
cifically Eqs. 45 and 46 of Ch. I), it follows that 


Q X X Q 


~A 

0 0 • 

• 0l 



0 

A 0 • 

• 0 

= A^ 

[130] 

0 

0 • ■ • 

A 




in which A is the determinant of Q. Hence if the rank of (2 is (w - 1), 
A — 0, and according to the relations 128 and 129 the rank of (2“ can 
be no greater than 1. Since the elements of are the cofactors of Q, and 
at least one of these is not zero because the rank of (J is (» — 1), the 
rank of (3“ cannot be less than 1. Hence the summary: 

If G has the rank n, then Q“ has the rank n. 

If Q has the rank « — 1, then G“ has the rank 1. 

If Q has any rank less than » - 1, then the rank of G“ is zero. 

In connection with considerations of this sort it is useful to observe 
that if a given square matrix Q has the rank 1, it possesses no more than 
one independent row and one independent column of elements, and hence 
it may be represented as the product of a column and a row matrix, thus: 


«i 

«2 


a = 


X [/3i 02 0n] 


an. 


[131] 


Similarly if a given square matrix has the rank 2, it possesses no more 
than two independent rows and two independent columns, and may 
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evidently be represented as 

r «ii 


a = 


«12 



Clnl an2j 


ftn] 

^2nJ 


The generalization of these statements is obvious. 


[132] 


9. Sylvester’s law of nullity 


From the preceding considerations it follows that if a square matrix Q 
of order n is given, and if this matrix has the rank ra and the nullity pa, 
a nonsingular matrix ffi can be found such that the product 

e = Q X S [133] 


has Pa null columns. For example, if pa of the columns of SB are the 
components bik, b 2 k, • • ■ Kk of the vectors bk* (k = I, 2, ■ • • pa), which 
are independent solutions to the homogeneous equations 


fli • bk‘ = 0 
02 • bk‘ = 0 


dn -bk = 0 


[134] 


pa of the columns in C are composed of zeros. The remaining fa columns 
in SB may be chosen arbitrarily as long as they are independent, that is, 
as long as SB turns out to be nonsingular. 

There is no nonsingular matrix SB for which C has more than pa null 
columns, because (since SB is nonsingular) C has the same rank as fl (see 
Art. 9, Ch. II) and hence must have fo independent columns. If, how¬ 
ever, pb of the remaining columns in SB are then chosen to be linear 
combinations of the above pa columns, C has pa -h pb null columns, and 
SB is singular with nuUity pb- Moreover any matrix SB with nullity pb 
which produces pa 4- pb null columns in C must have the form of the 
particular one chosen here, for pa -j- pb of its columns must satisfy Eq. 
134, and n — Pboi its columns must be independent. In addition, it is 
not possible for any matrix SB of rank rb to produce more than pa -f- pb 
null columns in C, because any such new column requires that another 
column in SB become a solution to Eq. 134, and thereby be a linear 
combination of pa of the independent colmnns already in SB. The rank of 
SB would then have to be less than r^. The nullity of C is therefore at least 
Pa + pb- But it cannot be greater than this because, if it were, post¬ 
multiplication of Eq. 133 by a nonsingular matrix ST could produce 
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another null column in C. This would demand that ST be a matrix of 
rank rt producing more than Pa + pb null columns in C, which has been 
shown to be impossible. Hence no matrix of nullity pb can give C a 
nullity greater than pa + pb, that is, 

pc-^pa + Pb [135] 


Of course pa + pb may exceed n, in which case evidently pc cannot be 
greater than n. 

Now let it be supposed that two nonsingular transformation matrices 
7a and 7b are determined such that 

(2' = 7 Ad [136] 


is a matrix whose first fa rows are independent and the remaining ones 
null, and 


= ffiTs 


[137] 


is a matrix whose first tb columns are independent and the remaining 
ones null. Then 


= a'ffi' = = e' 

has the same rank as C, but is evidently in the form 


^11 * 


0 • 

• 0 " 

Cfal ■ 

' ^Tan 

0 • 

• 0 

0 

. . . 


0 

_0 



0 _ 


[138] 


[139] 


It then becomes clear that the rank of C' and hence that of C cannot 
exceed fa or n, whichever is the smaller. Or the nullity of C must be at 
least as great as Pa or pb, whichever is the larger. 

Together with Eq. 135 this conclusion yields the smnmary 


pr ^ 
pc ^ 


+ 

! Pa > Pb\ 
\ P»> Pa } 


or stated in terms of rank, 


re Ta + Tb - n 


Tc ^ 


Ta <rb\ 

rb<ra j 


[140] 


[141] 


This useful statement regarding the rank or nullity of a product matrix 
in terms of the ranks or nullities df its components is known as Sylvester^s 
law of nullity (or degeneracy). 
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10. Reduction of a square matrix to the diagonal form of 

ITS LATENT ROOTS; NORMAL CO-ORDINATES 


In view of the vector interpretation of the linear transformation 


® 11*1 ■+•••• - 1 - flln*n = y\ 


®nl^l * -I” Onn^n — 


[142] 


as discussed in Art. 3 of this chapter, it is interesting to inquire whether 
there exists a vector x whose transform y has the same direction in space, 
that is, whether a solution to Eqs. 142 exists which conforms to the 
stipulation 


y — \x 

[143] 

or more specifically 


yi = \Xi (for i = 1, 2, • • • w) 

[144] 


in which X is a nonzero* factor. 

Substituting the values given by Eq. 144 for the right-hand members 
of Eqs, 142, and transposing these to the left-hand sides, yields the condi¬ 
tions 

(an — \)xi + ai2X2 + • • • + a^Xn = 0 

+ (^22 “■ ^)^2 + • • • + a2n^n = 0 flAsl 


GnlXi + an2X2 H-+ (^nn ““ X).Tn = 0 


This set of homogeneous equations has nontrivial solutions only when the 
determinant of its matrix (called the characteristic matrix of (2) is zero, 
that is, when 


(an •— X) ai2 • • • din 
(121 {(I 22 X) • • • a2n 




dn2 


{dnn - X) 


= 0 


[146] 


This determinant is called the characteristic function of the matrix (2. 
It is evidently a polynomial in X of the «th degree. The condition equation 
146, which is called the characteristic equation, is an algebraic equation of 
the wth degree in X, and hence there are n values of X for which the 
matrix of Eqs. 145 has at most the rank (n — 1). These so-called latent 
roots or characteristic values may be denoted by Xi, X 2 , * • • Xn- 
In the general case for which the matrix (2 of the transformation 142 is 
unsymmetrical, the latent roots may be real or complex. Also they may 


*The stipulation X = 0 leads to the inquiry regarding the existence of solutions to the 
corresponding homogeneous equations, which has been discussed previously. 
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be distinct, or there may be coincident roots. If all the latent roots are 
distinct, the rank of the characteristic determinant for any particular 
latent root X« cannot be less than (» -* 1); for if it were, all its (w — 1)- 
rowed minors would be zero, and hence its derivative with respect to X 
would also be zero when X = X*. This fact would indicate that X* must be a 
multiple root of Eq. 146, which contradicts the assumption that the 
latent roots are distinct. 

When the roots are distinct, one may conclude that there are n distinct 
directions for the vector x which remain unchanged by the transformation 
142, that is, there are n directions for which the vector y coincides with 
the vector x. These are given by the n vectors i, i, • • • 5 which are found 
to be solutions to the n sets of homogeneous equations 145 resulting from 
substituting successively the characteristic values Xi, X 2 , • • • \n for X. 

If the cofactors of the elements of the determinant in Eqs. 145 for the 

root X = X« are denoted by the direction cosines of the vector x are, 
according to Eq. 109, given by 

a 

ku 

4 . = -^ - (for * = 1, 2, • • • ») [147] 

(kiiy + (^12)^ + • • • + (^tn)^ 

in which the index i is arbitrary but must, of course, be the same for the 
determination of all the direction cosines corresponding to a given 
root X,. 

The components Xi, ^ 2 ? • * • of the vector x may be taken equal to the 

s a a 

cofactors kn, ki 2 , • • • kin respectively (i arbitrary) or to any multiple of 
these values since the length of the vector is not determined by Eqs. 145. 
Unit length for the vector x results when its components Xi^ X 2 , • • • in 
are taken equal to the direction cosines ^ 28 , • • * respectively. 

With the aid of the column matrices 


i] = 4 ] = 


the transformation 142 for the condition 144, appropriate to the root 
X = X„ may be expressed by the matrix equations 

fli] = X.i] [149] 


— a - 

Xi 


’4. 

a 

X2 


4. 

1- 

. . 

3 

1_ 


.4.. 


[148] 


or 


(24] = X,4] 


[ 150 ] 
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There are n matrix equations of this form for the n roots corresponding 
to the integer values 1 ,- 2 , • ■ • n for the indexes. 

These n matrix equations may be combined into a single one by de¬ 
fining the matrix 


r^ii 

ii2 * 

“ hn 

hi 

^22 • 

• ^2n 

Jnl 

fn2 * ' 

• • f 

* nn 


in which the first column is the column matrix 148 for 5=1, the second 
column is the folumn matrix 148 for s = 2, and so forth. The set of n 
matrix equations 150, for 5 = 1 , 2 , • • • m is then given by 



X,fu 

Xafiz 

* * ^n^ln 

«£ = 

Xl /21 

^2^22 

* * * ^n^2n 



^2^n2 

* * nn 


or, by the introduction of the diagonal matrix 


fXi 

0 

0 • 

• 0 

0 

X2 

0 • 

• 0 

_o 

0 




this is 


( 2 £ = £a 


It may now be shown that when the X-roots are distinct the matrix £ 
given by Eq. 151 is nonsingular or that the « vectors h, • x whose 
directions remain unchanged by the transformation 142 form a linearly 
independent set. The proof is readily given by assuming that this vector 
set is linearly dependent and showing that such an assumption leads to an 
absurdity.* 

The assumption that the vector set i, • • • 5 is linearly dependent is 
equivalent to the statement that the vector relation 

7ii + 72* H-1- 7n* = 0 [155] 

can be satisfied for 7 -vaIues other than all zeros. This vector relation is 
alternatively expressed by 

t y.x] = 0 [156] 

IT *1 


’*The proof given here was suggested by Professor D. J. Struik of the Department of Math¬ 
ematics at the Massachusetts Institute of Technology. 
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Multiplying Eq. 149 by 7 , and summing over s gives 

i ay,x\ = G i 7 .*] = i 7 .x.*] [157] 

a*l a*»l 

and in view of Eq. 156 this yields 

i 7 .x,*] = 0 [158] 

a —1 

Repeating the same process but with Eq. 149 multiplied by X, in addition 
to 7 „ and this time using Eq. 158 instead of Eq. 156, gives 

£ 7.X.2i] = 0 [159] 

a “1 

In other words the assumption expressed by Eq. 155 or Eq. 156 together 
with the matrix Eq. 149 leads successively to relations of the form 

£ 7.X.*x] = 0 [160] 

a*l 

or in vector form 

y{Ki^h + 72 X 2 *^ + • • • + 7nXn** = 0 [161] 

in which the exponent k can be 0,1, 2, • • •. For ^ = 0, Eq. 161 is the same 

as Eq. 155. 

Since the X-roots are assumed to be distinct, this result means that 
any number of independent relations of linear dependence among the 
vectors k, • x exist — clearly an absurdity. For example, in three- 
dimensional space, the existence of one relation of linear dependence 
means that the vectors lie in a plane; the existence of two independent 
relations of linear dependence means that the vectors lie in a straight 
line; the existence of three independent relations of linear dependence 
requires that the vectors be zero. 

If two of the X-roots are coincident, it might appear that two of the 
vectors x become equal (or at most proportional), since they then repre¬ 
sent two solutions to the same set of homogeneous equations 146. Under 
such conditions the modal matrix £, given by Eq. 151, would become 
singular by reason of the two proportional coliunns within it. It must be 
recognized, however, that the solution 147 for the various vectors * = f, 
is based upon the fact that the rank of the characteristic determinant is 
exactly « — 1, and although it is surely true when the X-roots are dis¬ 
tinct, it may or may not be valid in the case of repeated roots. In fact it is 
shown in Art. 4, Ch. IV, that, if the matrix G is S 3 anmetric, the occurrence 
of a repeated X-root of order p ^ n requires the rank of the characteristic 
determinant for that particular value of X to be n — It is then possible 
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by the methods discussed in Art. 7 of the present chapter to find p 
independent solutions to this single set of homogeneous equations, and 
to make these solutions orthogonal and of unit length if desired. Under 
such conditions, the present proof of the independence of the solutions 
for all the X-roots may be carried through without significant alteration, 
bearing in mind that the p solutions corresponding to the p equal X-roots 
are already chosen to be independent of one another. 

Unfortunately in the general case, when the matrix Q is not symmetric, 
there is no unique correspondence between the order of a repeated X-root 
and the rank of the characteristic determinant. The nullity of the char¬ 
acteristic determinant may be less (but not greater) than the order of the 
repeated root, in which case solutions for n independent vectors x cannot 
be found. For example, the unsymmetrical matrix 

'1 1 O' 

0 1 1 
_0 0 1 _ 

has a repeated latent root X = 1 of order 3, whereas the nullity of the 
corresponding characteristic determinant is only 1. Since the rank of the 
latter determinant is 3 — 1 = 2, it is possible to find only one independent 
vector X, and therefore any attempt to form a modal matrix yields a 
singular result. Hence the existence of a nonsingular modal matrix £ is 
guaranteed when and only when the matrix (2 is either symmetric, or 
has n distinct latent roots. 

In this case Eq. 154 may be premultipJied by to give 

£-"Q£ = A [162] 

The matrix Q is thus reduced to the diagonal form of its latent roots. 

The significance of this reduction, as far as the transformation 142 is 
concerned is recognized when the latter is written in matrix form. 


Q.x] = y] 

[163] 

and the changes of variable expressed by 


x'\ = £x'] and y] = £yT 

[164] 

are considered. Then, in view of Eq. 162, the transformation 163 becomes 

Ax'] = y'j 

[165] 

which represents the equations 


= y'l 


X^x'i = y'2 

[166] 

n ^ y n 
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It thus becomes clear that the change of variable expressed by Eq. 164, 
which amounts to transforming from the co-ordinates x and y to new 
co-ordinates x' and y\ reduces the set of simultaneous equations 142 to a 
set of n distinct equations, the solutions of which arc immediately set 
down. Another way of looking at this situation is to say that in the new 
co-ordinate system to which x^ and y^ refer, the variables x\ • ^ • x'n are 
no longer dependent upon each other as are the variables Xi - • • Xn in 
the original co-ordinate system to which x and y refer. 

In connection with physical problems, the new co-ordinates in which 
the equilibrium of the system appears to be expressed in terms of separate 
equations are called the normal co-ordinates of the system. The trans¬ 
formation to normal co-ordinates, which is effected by the matrix £, 
apparently isolates the various modes of behavior of the physical system, 
and for this reason the matrix £ is spoken of as the modal matrix. 

In view of the fact that the vector x, which constitutes a solution to 
Eqs. 146, is determined in direction only, it may be noted that the matrix 
a is still reduced to the diagonal form of its latent roots if in the relation 
162 the modal matrix £ has its columns multiplied by arbitrary nonzero 
factors. In other words, the matrix £ in Eq. 162 may be replaced by the 
product ££i) in which 2) is an arbitrary nonsingular diagonal matrix. 
Since the inverse of £2) is 2)’“^£""^, and 2)“^A2) = A, the truth of this 
statement is evident. 

The type of transformation 162 to which the matrix Q is subjected 
evidently corresponds to identical transformations for the variables, as 
shown by Eqs. 164. Thus a transformation of the matrix (2 of the form 

e-^ae = s [i67] 

corresponds to a transformation of the variables as expressed by 

x] = Cx'] and y] = Cy'] [168] 

in which C is necessarily nonsingular. 

The geometrical significance of these relations can be studied through, 
first of all, recognizing that the transformation 142 may be looked upon 
as determining a point yi • • • yn lying on a plane through the origin of 
co-ordinates defined by the equation 

Piyi + ^ 2^2 + * * * + finyn = 0 [ 169 ] 

corresponding to a given point Xi' • ^ Xn on a similar plane defined by the 
equation 

CtlX\ + a2^2 + • ‘ + OLn^n = 0 [170] 

It may be helpful in this connection to consider the coefficients ai • • • an 
to be the components of a vector a. Then Eq. 170 states that a • O!: = 0, 
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which requires that the vector x be orthogonal to the vector a, and hence 
that the point a;x • • • *„ lie in a plane normal to the direction of a. Equa¬ 
tion 169 may similarly be interpreted, and it follows from the solution 
of simultaneous equations that the components of the corresponding 
vector jS are given by the relation 

Pk = a*k- a (for k = 1, 2, • • • n) [171] 

in which a*i • • • is the vector set of the matrix Q* reciprocal to (2. 
According to Eq. 74, the coefficients /3* are thus seen to be the contra- 
variant components of a with respect to the oblique co-ordinate system 
defined by the vector set of G. 

If the matrix G is nonsingular, the transformation 142 yields a one-to- 
one correspondence between points on the two planes defined by Eqs. 
169 and 170. One may say that Eqs. 142 transform planes into planes 
and hence also straight lines into straight lines.* For tlus reason a linear 
transformation is also spoken of as a coUineation. 

If the co-ordinates Xj • • • and yi - • • yn define the points P and Q 
respectively, the coUineation 142 relates any chosen points Ply P^y • • * 
(not necessarily on the same straight line) to corresponding points 
Qiy Q 2 y • • • • The foregoing discussion in this article shows that a non¬ 
singular coUineation possesses n distinct points Pi • Pn (called the 
fixed points) to which the corresponding points Qi* • ' Qn are so related 
that the directions OPk and OQk {O denotes the origin of the co-ordinates) 
are coincident, and OQk/OPk == Xjb. This so-called descriptive or projective 
property is evidently placed in evidence by the coUineation which has 
the diagonal matrix A. The collincations with the matrices (2 and A have 
the same projective properties, and are therefore spoken of as being 
equivalent. 

More generally, any two collincations with the matrices (2 and related 
by Eq. 167 have the same projective properties. Equation 167, which 
expresses the equivalence of the two coUineations, is called a collineatory 
transformation of the matrix (2. 

The characteristic matrices of (2 and are related by the same trans¬ 
formation. With the aid of the unit matrix ^ of like order, the character¬ 
istic matrices of (2 and are expressed by 

((2 - X^) and (ffi - X^U) [172] 

*The truth of the latter part of this statement may be seen from the fact that the trans¬ 
formation 142 relates points on a given continuous curve to points on another conlinuous 
curve. If a plane pi is transformed into a plane />'i, and a second plane p 2 (not parallel 
to Pi) into the plane p^, points on the linear intersection of pi and p2 must correspond to 
points on the linear intersection of p\ and p'2] these points are common to the planes 
pi and p2 and, because of the continuity of the transformation, they must also be common 
to the planes p\ and p'2^ 
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But by Eq. 167 

(Q - \G{i)e = e-^ae - s - x^u [173] 

The characteristic function of fiB (determinant of the characteristic 
matrix) is therefore 

|ffi - x%| = - x%)e| 

= cr^\a - x^ulc = IQ - x^| [174] 

in which the bars enclosing the'matrix expressions indicate that the 
determinant of the enclosed matrix is meant, and C is the determinant 
of the matrix C. 

The important conclusion to be drawn from this last relation is that 
the two matrices Ct and SB, which are connected by the transformation 
167, have the same characteristic equation and hence have the same 
latent roots. In other words, the latent roots of a matrix are invariant to a 
collineatory transformation. 

In this connection it is useful to note that Eqs. 162 and 167 yield 

£“*eSBe~^£ = A [175] 

from which it is clear that the modal matrix for SB is given by the product 


11. The Cayley-Hamilton theorem 


An interesting relationship follows from Eq. 162, namely 
a X G = = £a£'‘^£a£“^ = £a^£“^ 


in which 



rxi" 

0 

0 

• 0 ] 

= A X A = 

0 

Xz"* 

0 •• 

• 0 


. 0 

0 


X 2 
An J 


[176] 


[177] 


This relationship may readily be generalized with the result that the mth. 
power of a nonsingular square matrix Q is given by 

(2’"=£a’"£-i [178] 

with 


X,”* 0 0 • • • 0 
0 Xa™ 0 • ■ • 0 


0 0 • ■ • X„’" 


[ 179 ] 
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If P{\) is a polynomial in X, that is, 

P(X) = OpX’’ ffp_iX*’ ' + • • • 4 " ®iX + <1 q 
the result expressed by Eq. 178 shows that* 

■P(Q) = ^ "h • • • 4" UiQ 4" flo^ 

= £P(A)£-* 


According to Eq. 179, however, 


P(A) = 


P(X,) 

0 


0 0 
Pi^2) 0 


0 0 


• 0 

• 0 


P{K) 


[180] 


[181] 


[182] 


and hence a polynomial in terms of a nonsingular matrix (? becomes 


P((J) = X 


P(Xi) 0 0 • • • 0 

0 PiXa) 0 • ■ • 0 


0 


0 


PiK)j 


X £ [183] 


This result becomes particularly interesting when the polynomial P(X) 
is chosen to be the characteristic function of the matrix Q, that is, 

P{\) = |Q - X<4l| [184] 


Then P{\) =0 is the characteristic equation and hence P(Xi) = 
F{\ 2 ) = • • • = P(Xn) =0. The right-hand side of Eq. 183 is then zero, 
and the left-hand side is the characteristic function of Q with the matrix 
(i itself substituted in place of the variable X. The conclusion follows that 
the matrix (i satisfies its own characteristic equation. 

The above derivation requires that the modal matrix £ be nonsingular, 
which means that the matrix (2 is either symmetric or has n distinct 
latent roots. In spite of these restnetions on the method of derivation 
employed here, it can be shown that the last result, which is known as 
the Cayley-Hamilton theorem^ is true in general for any square matrix.f 

A numerical illustration is given by the following: 


a = 



~1 

2 

1 



[185] 


*It should be observed that the constant term in the pol 3 momial P((i) is ao®®, and that 
the zero power of a matrix is equal to the unit matrix of like order. 

tSee, for example, L. E. Dickson, Modern Algebraic Theories (New York: Benj. H. Sanborn 
and Co., 1926), p. 48. 
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The characteristic equation is given by 

-X -1 -3 

-1 (2 - X) -1 =0 

1 1 (4 - X) 

which yields 

X® - 6X2 + IIX - 6 = 0 [186] 

or in factored form 

(X - 1)(X - 2)(X - 3) = 0 [187] 

Hence the Cayley-Hamilton theorem in this case states that 

(23 _ 6G2 + llG - 6% = 0 [188] 


or in factored form that 

(G - %)(G - 2eU)(Q - 3GU) = 0 [189] 


Substituting the matrix G from Eq. 185 into the last equation yields the 
identity 



= 0 [190] 


which the reader may readily verify for himself. 

It is worth noting from Eq. 188 that higher powers of the matrix G are 
expressible in terms of powers up to and including the (w — 1 )lh. Thus, 
for example, 

G3 = 6G2 - IIG + 66U 

G^ = 6G3 - 11G2 + 6G = 25G2 - 60G + 36^11 [191] 

G® = 25G3 - 60G2 + 36G = 90G2 - 239G + 150^ 
and so forth. 

In a similar manner, negative powers of G may be calculated. Thus 
from Eq. 188 in the above example 

6G-1 = G2 - 6G + IIGU 

6G-2 = G - + llG-' = -V-G2 - lOG + [192] 

and so forth. In particular, the inverse of G by this method is found to be 

■917" 

G-* = -^G^ - G + = ^ i 3 3 [193] 

-3 -1 -ij 
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12. SYMMETRICAL TRANSFORMATION 

Returning to the discussion of Art. 10, note that when the matrix of 
the transformation 142 is symmetrical, the vectors x whose directions are 
left imchanged by the transformation form a mutually orthogonal set. 

The truth of this statement may be seen by considering Eq. 149 for 
two particular latent roots X, and X*, thus 

Qa] = X,i] [194] 

el] = Xil] [195] 

The transpose of the matrices in Eq. 194, postmultiplied by x] reads 

xltdtx] = X,x],x] [196] 

and Eq. 195 premultiplied by the transpose of i] is 

= x,i],l] [197] 

Now if 0. is symmetrical, it is equal to its transpose (?<, so that Eqs. 196 
and 197 then yield 

X,x]<x] = \kx\ix] [198] 

or 

(X, - XA)i:],x] =0 [199] 

Written out, this reads 


= (X,-Xt)(:ri^:+X2^2+ • • • +XnX„) = 0 

[ 200 ] 


which is alternatively expressed by the scalar product 

(X, — X*;)i ■ X - 0 [201] 

Since this result states that the scalar product of two vectors corre¬ 
sponding to two different latent roots is zero, the vectors must be normal 
to each other. In the case of repeated X-roots, it is pointed out in Art. 10 
of this chapter that the correspwnding x and x can always be chosen to be 
orthogonal. Thus the apparent failure of the conclusion drawn from 
Eq. 201 in this instance is not significant. 

In view of Eq. 201 it is also easy to show that the latent roots of a 
symmetrical matrix must be real. For if they were complex they would 
have to appear in pairs of conjugates,* for example, 

X, = a + i/3 and Xjt = a — j/S [202] 

‘Since the matrix is assumed to have real coefficients. 


(X.-X*)[xiX2 ■ ■ - Xn] 


X2 


k 

Xn 
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and the vectors x and x satisfying Eqs. 194 and 195 would likewise 
have to be conjugate complex, thus 

X u + jv and x = u — jv [203] 

Their scalar product is given by 

X'X — U'U + v-v+jiu-v — V'u) [204] 

which is a real nonzero value. Hence Eq. 201 would demand that X, = 
or 

a — a — jfi [205] 

whence 

= 0 [206] 

In other words, the latent roots must be real. 

When the vectors x form a mutually orthogonal set, the modal matrix 
given by Eq. 151 becomes orthogonal, because its elements are then the 
direction cosines of a set of mutually orthogonal axes. Hence when the 
matrix (i is symmetrical, its modal matrix has the property expressed by 

[207] 

and the transformation of (J to the diagonal form of its latent roots reads 

= A [208] 

In this case, the normal co-ordinates of the physical system whose 
equilibrium is expressed by Eqs. 142 are orthogonal to each other. 

Since the matrices encountered in practical problems are predomi¬ 
nantly symmetrical, the results of the present article are quite significant. 
These matters are elaborated upon in Ch. IV. 

PROBLEMS 

1. Determine the rank of each of. the following vector sets: 

f(5,3, -1) f( 3,4, -1) [(1,2,4) 

(a) (10,0, 2) (b) (-1.5,2,-0.5) (c) (1,3, 9) 

1(0,1, 0) [( 6,8, -2) 1(1,4,16) 

( 1 , 1 , 1 , 1 ) [( 1 , 1 , 1 ) 

(2, 2, 2, 2) (f) (l,e^<2./3)^^i(4T/..)) 

(3, 3, 3, 3) [(l,e-->(2r/3)^^~i(4,r/3)) 

(4, 4,4,4) 

[(l,2^2^...2--l) 

(1,32, 33,-..3”-^) 

(g) ( 1 , 42, 42,... 4«-0 



(l,n2, 
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2 . A given vector set ai, Oo, • • * in an n-dimensionaJ space (with w < n) is 
linearly dependent as expressed by 

aiax + H-+ OLynOtn = 0 

Show that all determinants of order w, formed from this vector set, vanish identically. 

What can you say about the rank of the vector set if all the a^s have finite nonzero 
values? If all but one of the a's are zero? 

Which of the following vector sets is linearly dependent? What is the rank of each? 

[( 6a, ^26, ~4c, 2) ((6,7,9,11,13) 

( «, b, c, d) 1(2,4,6, 8,10) 

[(~3a, h, 2c, -1) 

3. Consider the vector set ai, 02 , • * • a,n in an ^-dimensional space with tn = w -f 1, 
and suppose that the first n vectors ai, • • • a„ are linearly independent. Show that one 
may write 


== Otiidi 4 - Cii2fl2 + * • * ’{'OiinOn 

and express the coefficients a 1 * in terms of the determinant of the vector set ai, • - a^, 
its cofactors and the components of the mXh vector. 

Generalize this result for the case m^n + p with /^ > 1, and illustrate with the fol¬ 
lowing numerical example: 


((-1, 

-2, 

-3) 

( 2, 

4, 

5) 

( 1, 

1, 

1) 

( 1, 

3, 

5) 

l(-l, 

0, 

1) 


4. Consider three vectors in three-dimensional space. The vector ai has a length of 
eight units and is directed at an angle of 45® relative to the co-ordinate axis 3, while 
its projection upon the 1,2-plane makes angles of 45® with both axes 1 and 2. The 
vector ai lies in the 1,2-plane, having a length of six units, and oriented at angles of 
30® and 60° respectively relative to the axes 1 and 2. The vector a^ has a length of 
four units and coincides wath axis 3. Write down the matrix corresponding to this 
vector set. Express each of these vectors linearly in terms of the three unit vectors 
coinciding with the co-ordinate axes. 

5. The vector set ai, a 2 , • • * in an n-dimensional space has the rank m = « — 1. 
Show that 

n 

S O'ikAnk =0 for 1 - 1, 2, • • • » 

jfc-i 

and interpret the significance of these equations geometrically. Suppose that this 
vector set is so chosen that the components ain have finite nonzero values. A set of n 
vectors biy in an w-dimensional space is now defined with the components 

bik = CLiklO'xn- Obtain for this vector set the relations 

OLihii + aibii -1--f ambim ===1 for £ == 1, 2, • • • « 

giving the appropriate expressions for the coefficients ctuy and show that all these 
vectors terminate in the same plane. What is the equation of this plane? 



m 


LINEAR TRANSFORMATIONS 


[Ch. Ill 


lUustrate this problem for n — 4 with the vector set 


( 

1, 

1,0, 

1) 

( 

2, 

3, 1, 

1) 

{ 

4, 

0,2, 

1) 

(- 

-2, ■ 

-2,0, 

-2) 


6. Consider again the vector set of the previous problem and show that 
2] aaAin =0 for ^ = 1, 2, • • • w 

t =1 

Assuming that the vectors are so numbered that Ann 5*^ 0, deduce the result 
— a„ = ex id I -f CX2(l2 4 * * * * -f* an—ldn^i 


giving the values of the coefficients or*. Determine this relation of linear dependence 
for the numerical vector sets: 


( 

I. 2, 

1,0) 

[ (4, 2, 5, 

1) 

( 

3, 0, 

4,1) 

(3,0, 4, 

1) 

( 

h 0, 

0,1) 

(io,o. 

-1) 

(■ 

-2, -4, 

-2,0) 

L (0,3,1, 

1) 


7. Suppose the vector set ai ••• an of a matrix Q in an w-dimensional space has 
the rank r = w — /> (1 < p <«), and assume the numbering of the vectors and com¬ 
ponents to be so chosen that the rth order minor in the upper left-hand comer of the 
determinant A is nonzero. Obtain linear relations between each of the p dependent 
vectors and r independent ones by the following procedure. 

From the original matrix, form submatrices by striking out all but the first r 
columns and all but one of the last p rows. Call this row the (r -f i)th. There are p such 
submatrices as i goes from f = 1 to i = p, and each submatrix then consists of r 
columns and r -f 1 rows. A group of r + J minor determinants of order r is now 
obtained from each submatrix by deleting therefrom the A^th row', with /b - 1, 2, 
• * • r 4* 1- Each of the minor determinants so generated is prefixed by a sign-con¬ 
trolling factor ( —to yield a “signed minor,” denoted by aik. Note that 

ai.ri 1 = az.r+l =•••=== Olp,r+l 0. 

Show next that the following systems of relations hold 


r + l 

2 ^ OCik(Jk€i ~ 0 
k^l 


(f = 1,2,---/.) 
{q = 


or that one may wTite the desired set of relations of linear dependence among the 
vectors: 

«iiai 4- ai2a2 4- * * * -{-ai.r+iar-fi — 0 
CX2ld\ 4- 0:22a2 4* * * * + «2.r4 iar-t 2 = 0 


apidi -f- o:p2a2 H - “b a^.r+iar+p == 0 

Illustrate with the numerical vector set of rank 2: 

( 2 , 1 , 6 , 8 ) 

(1,1,3, 5) 

(0,4,0, 8) 

I (0,1,0,2) 

8. Consider two vector sets ai • • • On and bi - • • bn with the square matrices (? 
and ffl 
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(a) If the vectors in the two sets are connected by the relations 

n 

Z) Ciyik = hi for t = 1 , 2 , • • • w 
k =1 

in which the matrix C is nonsingular, show that the components are connected by the 
matrix equation 

e xfl = a 

and that the components of the corresponding transposed vector sets are related by 

<2t X C* = 

(b) Regard ai ••• an as a given vector set and as obtained from ai - • • an 

through linear transformation with the nonsingular matrix C. Show that the rank of 
the vector set is invariant to this transformation but that such would not be the case 
if C were singular. 

9. Two vector sets ai • • • a„ and with the square nonsingular matrices 

a and have the matrix products 

Qffi = and ffiQ = a 

(a) If the set ai • • • On is transformed by a nonsingular matrix C as indicated by 

ae ^ a 

how must the set be transformed in order that (P = 

(b) Derive the corresponding relation between S and S, and show that the 
determinants of these matrices are equal. 

10. Let Pi and Pj be two points in an ^-dimensional orthogonal Cartesian co¬ 
ordinate system. The vectors Xi and with components * * • xin and X 21 • • • x^n 
respectively emanate from the origin of co-ordinates and terminate upon the p)oints 
Pi and P 2 . 

Express the direction cosines cosai, cosa 2 , ’ * • cos an of a vector drawn from P 2 
to Pi in terms of the components of xi and X 2 and the distance / between Pi and P 2 , 
and prove the identity 

cos^ ai + cos^ a2 + • * • + cos^ an ^ 1 

11. With respect to an oblique co-ordinate system, the contravariant components 
of a vector x are denoted by { 1 , f 2 , • * • {n and its covariant components by j*i, ^•‘ 2 , 
• • • {*n. The corresponding components of another vector y are rjh V 2 y • • • Vn and 

V*2t • • • If the contravariant components of the two vectors are related by the 
matrix equation 

and the covariant components by a similar equation with the matrix SB, how is SB 
related to (J ? 

12. In an oblique co-ordinate system two vectors Xi and X 2 have components which 
are conveniently expressed as the elements of the following row matrices: 

[ill ii2 • • • fin ] [f2i f22 • • • f2n] (contravariant) 

[fll fl2 • • • fin] [f21 f 22 • • • f2n] (cOVariant) 

The lengths of these vectors are h and fc, 0 is the angle between them, and d is the 
distance between their tips. 
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(a) Prove that; 

= Ki* - X [^u - [1] 

and 

COS0 = [Xu] X [X* 2 j« = [X 2 J X [X*u]t [2] 

in which Xu = and X*u = 

(b) Prove the invariance of these expressions under any linear transformation of 
co-ordinates. 

(c) Show that Eq. 1 is equivalent to 

d- - -h - 2 / 1/2 cos e 

(d) For any vector x with contravariant and covariant components and f**, 
show that 

[X,] X - 1 

Observe that \k = ^k/l or X*a: =- ^*k/l cannot be represented as the cosine of a real 
angle but that - 1 ^ Xi-X*^ ^ 1 . (The \k are called direction parameters and the 
X*it the moments of the vector.) 

(e) In a given w-dimensional co-ordinate system let \sk and X*u be the parameters 
and moments of a set of vectors whose components are regarded as the elements of 
row matrices. If a new co-ordinate system is introduced through a transformation with 
the nonsingular matrix [cu], the parameters and moments are carried over into the 
values X«ik and X*«a;- Show that the following expressions apply: 

[XaJt] ~ [Xfltj X [^^lA:] and ^ [X**t] X [CtA;]^ ^ 

lv3. The row's in the following matrix represent components of a given vector set in 
an orthogonal Cartesian co-ordinate system: 

'4-5 ll 
-2 5 ->1 

_ 3 0 ij 

(a) Compute the magnitudes of these vectors, their direction cosines, and the cosine 
of the angle between each pair. 

(b) Find the inverse matrix and, for the inverse vector set which it represents, 
compute the corresponding quantities to those in part (a). 

(c) Make a 120° isometric plot showing all vectors. 

14. Make computations as in parts (a) and (b) of Prob. 13, considering the matrix 

“I 4 1 3” 

0-13-1 
3 10 2 

J -2 5 1. 

Repeat the computations, using the transposed matrix. 

15. (a) Consider the vector set of Prob. 13 to define the directions of an oblique 
co-ordinate system. With reference to the original orthogonal Cartesian system, the 
new vector [1,3, — 1] is given. For this vector compute the contravariant and covari¬ 
ant components, as well as its direction parameters and moments (see Prob. 12). 

(b) Make an isometric plot showing the position of the vector and its above- 
mentioned components. 

(c) Repeat part (a) with reference to the vector set of Prob. 14. 
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16. Let the direction parameters Xi* and X 2 * for k = 1, 2, • • • » be regarded as the 
contravariant components of two vectors vi and (sometimes called “ versors”). 
If $ is the angle between these versors, show that 

n 

Sm^S = 2} (iijtkt •“ )XliXl;X2JtX2f 

ifjXt *1 


~ ^tjXliXi,* ^ toX2&X2f j — ( X) ga^U^2}^( X] g;fXi;X2f^ 

\i,,7 =1 / \k,t =»1 / \i,k=l / / 


in which ga are the components of the fundamental metric tensor. 

17. The matrix of the fundamental metric tensor in a given space of four dimensions 
is 


r2 


@ = 


1 

1 

1 


1 1 
4 2 

2 3 
1 1 


1 

1 

1 

1 


Compute: 

(a) The angles between the oblique axes. 

(b) The corresponding metric coefficients (reciprocals of the lengths of the unit 
vectors ai * • • <24 of the oblique system). 

(c) The length of a vector whose contravariant components are (5, 3, 2 , 1 ), and 
its direction parameters. 

(d) Compute the matrix 

(e) The angles between the oblique axes defined by Q*. 

(f) The corresponding metric coefficients. 

(g) The covariant components and moments of the vector given in part (c). 

18. Let § be the fimdamental tensor corresponding to a system of oblique axes 
and let be a column matrix whose elements are the contravariant components of a 
vector. Because of a co-ordinate transformation with the nonsingular matrix C, the 
contravariant components of the given vector become the elements in the column 
matrix {] = C X £]. Denoting by S the matrix of the fundamental j^nsor with 
respect to the new co-ordinate axes, what are the expressions for 9 and 9* in terms 
of @ and 9*? 

Taking for 9 the matrix in Prob. 17, and (5, 3, 2, 1 ) for the contravariant com¬ 
ponents of the given vector, compute the corresponding components of the vector 
with respect to the new coordinates if the transformation matrix is 

“1 4 1 3 “ 

p 0-13-1 
* 3 10 2 

J -2 5 1 ^ 

Compute the angles between the new co-ordinate axes. 

19. Consider an oblique co-ordinate system and a point P such that all the contra 
variant components of a vector drawn from the origin to P are positive. The portions 
of the oblique axes coinciding with these vector components are regarded as the 
coterminous edges of a parallelepiped. 

(a) Show that the volume of this parallelepiped is given by the formula 

V = 
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in which G is the determinant of the matrix @ and Ji, ^ 2 , $3 are the contravariant 
components of the vector. 

(b) Write down the expressions for the areas of the faces of this parallelepiped 
which lie in the 1,2-plane, the 2,3-plane, and in the 3,1-plane respectively. 

(c) Recognizing that the extension of the above formula to more dimensions reads 

F = VG 

compute the volume of the hyper-paraUelepiped in four-dimensional space defined by 
the matrix S of Prob. 17 and a vector with the contravariant components [1, 2, 3, 1]. 
Compute the area of the parallelogram for each pair of co-ordinates. 

20. Let xijX 2 j ‘ ‘ • Xn be the contravariant co-ordinates of a point P in w-dimen- 
sional space with respect to a set of oblique axes. This system is regarded as immersed 
in an m-dimensional space with w > n. In the /w-dimensional space the co-ordinates 
of the same point P with respect to an orthogonal set of axes are yi, y 2 , • • • ym. The 
orthogonal and the oblique axes have coincident origins. 

Show that the y^t’s are expressible in terms of the Xk& in the form 

n 

S aikXk = yi (i = 1,2, • • • w) 

*=i 

but that not more than n of the y^’s are independent. More specifically if the first n of 
the above equations are independent show that yn+i, yn+ 2 ,' ‘ ' ym may be expressed 
in terms of yi • • • yn by means of the relations 

J n ri 

-T aikA jkyi ^ yi (i = w -f 1,« + 2, • * • w) 

A *=--1 


in which A is the determinant corresponding to the first n rows of the matrix [o^n] and 
A jk are the appropriate cofactors. _ 

Show further that the squared line element ds^ is expressed by 


ds^ = 2^ {dykV 

k=l 


V V V 

« =1 * = i >=1 dxk dxj 


dxk dxj 


n 

= £ SkjdXk dxj 

k,j =1 


in which 

dyi dyi 

**' kidxkdxi 

are the components of the fundamental metric tensor in the n-dimensional space. 
Compute the values of gkj in terms of the art of the transformation. 

2l. Let x] and a] be column matrices and regard their elements xi‘ • • Xn and 
ai • • • a„ as components of a variable vector x and a fixed vector a with respect to an 
orthogonal co-ordinate system. 

(a) Show that the equation 

a]tx] = d (a scalar) 

represents the equation of a plane, that the vector a is normal to this plane, and that 
its distance from the origin is / = d/(magnitude of a). 

(b) In transforming to a new system of oblique co-ordinate axes, show that the 
distance of I and the point defined by a will not change if the vector x is subjected to 
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the transformation 

Q**] = a 

whereas the vector a transforms as 

Qa] = a*] 

22. Let J] and a] be column matrices whose elements are the contravariant com¬ 
ponents of a variable vector and a fixed vector respectively with reference to an 
oblique set of axes in three-dimensional space. Show that the plane defined by 

X J] = (a scalar) 

cuts the co-ordinate axes at points whose distances to the origin are given by 



and that the cosines of the angles that the plane makes with the co-ordinate axes are 

cos dj = - 

in which \a\ denotes the length of the vector a. 

23. Let the equations of two planes be given by 

«]« X and j 8 ]t X {] = 

Show that they intersect at an angle 6 for which 

cos B = j^ -p a \, X 9 X /3] 

and compute this angle for the planes corresponding to vectors a and /3 with com¬ 
ponents 3, —1,4 and 2, 8 , 6 with 




24. Suppose that a space of three dimensions is immersed in a space of four dimen¬ 
sions. Let y be a vector whose components when referred to a set of orthogonal axes 
in the four-dimensional space are yi, y 2 , ya, y 4 . The point determined by this vector 
lies also in the three-dimensional space and is there characterized by the co-ordinate 

^ 1 , X2y Xz, 

Denoting three constant vectors in the four-dimensional space by a, 7 , show that 
the equation 


yi y 2 y8 y\ 

ai az as ot^ 

Pi Pi Pz p4 

7i 72 78 74 


d (a scalar) 


represents a plane in the three-dimensional space and find the equation of this plane 
in terms of the x-co-ordinates, recognizing that one may write 
3 

Z) ciikXk = yi for i == 1, 2, 3,4 

ifc-i 
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25. With respect to an orthogonal set of axes in three-dimensional space, three 
points Pi, P 2 , Ps determined by the linearly independent vectors /3, X lie in a plane. 

(a) Write the expression determining a variable vector x which terminates in this 
plane. 

(b) Determine a unit vector perpendicular to the plane. 

(c) If the points Pi, P 2 , P 3 are transformed into Pi, P 2 , P 3 through a nonsingular 
transformation with the matrix Q such that the vectors become 

a] = flfa] 

« - 

7 ] = Qty] 

show that the transformed vector = Qtx] terminates in the new plane. 

(d) Let the components of a, /3 ,7 be given by (3, 2, 1), (4, 1 , 5), (1, 1, 1), and find 
the transformed plane corresponding to 

“=[! ^ 1] 

26. Let P be a variable point on the surface of a hypersphere of radius p and with 
its center at Pq. P and Po are determined respectively by the variable vector x and 
fixed vector a. The co-ordinate system is orthogonal and the equation of the hyper- 
sphere is given by 

[xk - ak]i X [xk - ak] = 

in which Xi - • • Xn and ai • • • ofn are regarded as elements of column matrices. 

If the points P and Po are transformed into P and Po through a nonsingular trans¬ 
formation with the matrix G, compute the distance between the two new points P 
and Po and show that the new point P does not in general lie upon a new hypersphere. 
Illustrate for « = 2 with ai = a 2 = 1 and for the matrix 

find the locus of the point P as the point P traverses its circle. 

27. (a) If a matrix £B is obtained through a collineatory transformation of the 
matrix Q, show that the matrices and are obtained through the same collin- 
catory transformation of the matrices G** and Q“^. 

(b) If matrices ® and 5 are obtained through the same collineatory transformation 
of matrices G and 2) respectively, show that the matrices (SB -f- S), SBS, 6SB, 
(SBS)~S (SSB)""^ are obtained through the same collineatory transformation of 
(G + 3))i G3), 3)G, (G9))'“^ and (3)G)-^ respectively. 

(c) If SB is obtained through a collineatory transfonnation of G, how is SB< related 
to G<? 

(d) Make a collineatory transformation of the matrix 


‘ 3 

2 

ll 

-1 

1 

r 

G= -4 

1 

1 with the matrix C = 

1 

0 

-2 

.-1 

-2 

5j 

1 

-2 

1 


(e) Let X and a respectively be a variable and a fixed vector, and assume that 
a]( X x] = 0. If y] = C“^Cx], in which G and C are nonsingular, determine the 
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vector P satisfying the relation P]ty] = 0 and illustrate for « * 3 with a]t = [3, 2 , 1 ] 
and matrices u and C as given in part (d). 

28. Find the latent roots of the following matrices 




1 

0 

0 


-13 241 ri 2 4l ri91 
-11 21 13 9 114 

-6 12j Ll 4 16j L S5 


-257 

-152 

-115 



29. Find the latent roots of the matrix 



Form the modal matrix £ and check numerically the relation = A. Make an 

isometric plot showing the directions of the principal axes. 

30. Prove that the determinant and the rank of a matrix remain invariant under a 
coUineatory transformation. 

31. Show that the roots of the characteristic function are invariant to elementary 
transformations of the characteristic matrix. Through an appropriate succession of 
elementary transformations of the characteristic matrix, show that the latent roots 
of the matrix 


"5 0 -1 0 “ 

0 5 0 -1 

9 15 0 

-0 9 0 5. 

are Xi * Xs = 5 — jf3 and X 2 = X 4 = 5 +^3. 



CHAPTER IV 


Quadratic Forms 

1. The quadratic form associated with a linear transforma¬ 
tion 

If in the linear transformation 


aiiXi + al 2-^*2 + • • * + O-ln^n — 3^1 
0'2l^l + ^22^2 + * • * -f 02n^n = 3^2 


+ ^n2^2 + * * * + dnn^n — 


[1] 


the equations are multiplied respectively by :ri, :r 2 , • • • the sum of the 
resulting left-hand members is a rational entire function which is homo¬ 
geneous and quadratic in the variables Xi - — Xn> This function is called a 
quadratic form. More specifically it is referred to as the quadratic form 
associated with the linear transformation 1. 

Written out, this function has the appearance: 

f = auXi^ + ai2X2Xi + • • • + amXnXi 
+ a2iXiX2 + 022^2^ + * • * + Cl2nXnX2 


“f" afiiXiXfi "j“ ^n2^2^» “h • * • ~j“ a^ifiXfi 

The terms on the principal diagonal of this square array involve the 
squares of the variables • • • jCn; the remaining terms involve all the 
possible cross-products. 

The matrix Q of the transformation 1 is called the matrix of the 
quadratic form, and its determinant A is referred to as the discriminant 
of the quadratic form associated with this transformation. This chapter 
is concerned with real quadratic forms, that is, such forms which have 
matrices with real elements. 

The writing of this function can be abbreviated through the use of a 
double summation, thus 

n 

-F = O^ikXiXk [3j 

1, Jk=»l 

Here the terms for i = 1 and k from 1 to n are those in the first row of 
Eq. 2; the terms for i = 2 and k from 1 to w are those in the second row of 
Eq. 2, and so forth. 

Since the terms with aik and aki for like values of i and k {k i) involve 
the product of the same pair of variables Xi and Xk (for example, the terms 

132 





Art,/] QUADRATIC FORM OF A LINEAR TRANSFORMATION 133 


ai 2 XiX 2 and a 2 iX 2 Xi)^ the quadratic form is evidently no less general if the 
matrix Q of the associated linear transformation is assumed to be sym¬ 
metrical; that is, if 

dik = dki or Qt = Q [ 4 ] 

Hence in the discussion of quadratic forms it is possible to assume that 
the associated linear transformation is a symmetrical one, and thus to 
make available to the discussion the special properties of such transforma¬ 
tions pointed out in the last article of the preceding chapter. 

A quadratic form may also be thought of as obtained through the 
squaring of a linear form; thus 

F = (aiXi + 0 : 2^2 + * • * + OtnXny [ 5 ] 

although the result is less general because it contains only n arbitrary 
coefficients.* Its formal appearance is, however, the same, as may be 
seen if all the terms in the full square represented by Eq. 5 are system¬ 
atically written down; thus 

F = 0^1 + aia2XiX2 -f- • • • 4“ aianXiXji 

-f- Qf 2 Qf 1 .T 2 .V 1 -)- a2^^2^ _|_ . . . -j.. a2CinX2Xn 


+ QfnQfi-T^tXi + anOt2XnX2 + * * * + 


Identification of Eqs. 2 and 6 leads to the relation 

Clik = oLiak [7] 

The function F as given by Eq. 5 is more convenient for the derivation 
of the following useful relations. Thus it is readily seen that the partial 
derivative of F with respect to one of the variables Xi is given by 

dF 

= 2ai{aiXi + a 2 X 2 + * * * + anX-n) [ 8 ] 

dXi 

By substitution of Eq. 7, the corresponding result for the function F of 
Eq. 2 readsf 

1 

2 

This result allows the quadratic form to be expressed in terms of its par- 

*The rank of the quadratic form (which is the rank of its matrix) is in this case 1, as rruiy 
be seen from the fact that the coefficients given by Eq. 7 are formed in the same fashion as 
are those of the matrix in Eq. 131, Ch. III. For the present discussion the rank of the quad¬ 
ratic form is immaterial. 

fThis result may, of course, also be obtained directly from Eq. 2j utilizing the symmetry 
condition 4. 


dXi 


= duXi -f- ai2X2 + • • * + dinXn 


[9] 
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tial derivatives thus, 


dF dF 

T *1 + - — • X2 + 
dXi dXz 


or in the more compact notation as 


" 2^1 dXi""' 


+ T— • *nf 

dXn J 


[ 10 ] 


[ 11 ] 


Correspondingly, the linear transformation 1 associated with a quad¬ 
ratic form F may, according to Eq. 9, be written in the form 

1 dF 

i = 1, 2, • • • ») [12] 

2* doo^ 


2. Geometrical interpretation of a quadratic form; the 

QUADRIC SURFACE ASSOCIATED WITH A LINEAR TRANSFORMATION 

According to the derivation of the quadratic form from its associated 
linear transformation 1, it is clear that the function F may be identified 
with the following bilinear form in the variables Xi - • • Xn and yi • * • yn-' 

F = Xiyi + X 2 y 2 H-h Xnyn [13] 

llxi - • -Xn and yi • • • yn are regarded as the components of the vectors x 
and y respectively, the quadratic form is represented by the scalar 
product 

F ^ x-y [14] 

That is to say, the value of the quadratic form may be expressed as 
the scalar product of the vector x with its transform y. Of interest in 
connection with this interpretation is inquiry into the significance of the 
equation 

F ^ 1 [IS] 

or in other words into the question: For what values of the variables 
aci • • • Xn does the quadratic forin maintain a constant value? In Eq. 15, 
the constant value is arbitrarily set equal to unity. The question may, in 
view of Eq. 14, be stated in another way: For what lengths of the vector x, 
which, it is assumed, may have all possible orientations, does the scalar 
product of the vector with its transform y have the fixed value unity? 

As the vector x assumes all possible orientations, under the stipulation 
that its scalar product with the vector y maintains a unit value, its length 
is evidently forced to vary in a very definite manner. The tip of the vector 
Xy therefore, describes a surface (in w-dimensional space this surface is 
w — 1 dimensional), and the solution to the inquiry stated above is seen 
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to resolve itself into the determination of the surface defined by Eq. 15, 
in which F is a function of the variables Xi - • • Xn- 

Since the function F is quadratic in the variables Xi • • • x^ the surface 
in question is evidently one of second order, which is also known as a 
quadric surface. In three dimensions the quadric surfaces are those of the 
familiar ellipsoid, the paraboloid, or the hyperboloid. The quadric sur¬ 
faces in w-dimensional space may be visualized in a similar manner, 
although their reality is, of course, lost. 

Since the function F contains no linear terms, its value is unchanged if 
the algebraic signs of all the variables are reversed. This fact means that 
the vector x satisfying Eq. 15 has the same length when its direction is 
reversed. Hence the quadric surface is symmetrical about the origin. 
A surface of this type is referred to as a quadric surface (alterna¬ 

tively as a central conic). 

The central quadric surface has hyperbolic or ellipsoidal characteristics, 
or both, depending upon the values and the algebraic signs of the co- 
eflScients aik in the form F. This question is discussed further in a subse¬ 
quent article. 

3. Transformation of variables 

When the variables JCi • • • Xn in the quadratic form given by Eq. 3 are 
subjected to a linear transformation such as 

xl = ex'] [16] 

in which x] and x'] are the column matrices 



and e is an arbitrary square matrix of order w, then F becomes a quadratic 
form in the new variables x'l • • • x'n- When the matrix C is nonsingular, 
the new variables are uniquely related to the original variables Xi • • • x^ 
and hence for given variables Xi • • • Xn the quadratic form expressed in 
terms of the new variables has the same value. In other words, the 
quadratic form in the original variables is identical with that expressed 
in terms of the new variables, the change of variable being nothing more 
than a formal change in the notation. 

At the same time, the transformation expressed by Eq. 16 may have 
the geometrical significance of a change of co-ordinate systems. In any 
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case, the immediate problem is to determine the matrix of the quadratic 
form for the new variables in terms of its matrix for the original variables 
and that of the transformation 16. 

For this purpose, it is useful to recognize that Eq. 2 for the quadratic 
form may be written in matrix form. First the transformation 1 is written 
in the matrix form 

Qx] = y] [18] 


in which C? is the matrix of the coefficients appearing in Eqs. 1, and y] 
is the column matrix 


y] 


yi 

y% 


lynj 


[19] 


According to the form for F given by Eq. 13, it is seen that 


F = 


* y] 


[ 20 ] 


in which is the transpose of the column matrix x]. Substituting for 
y] from Eq. 18 yields the desired matrix expression for F, namely, 

F = ^ax] [21] 

The expression for F in terms of the new variables x\ • • • x'n is now 
readily obtained by substituting for x] from Eq. 16, and recognizing that 
the transpose of this equation gives 

^ ~ [ 22 ] 


Thus it is found that 

F = X Q X ex'] [23] 

which may be written 

F = ^^x'] [24] 

in which 

= e, X Q X e [25] 

is the desired matrix of F for the new variables x\. 

Equation 25 gives the transformation formula for the matrix of a 
quadratic form when its variables are subjected to a linear transformation 
with the matrix C. This is called a congruent transformation of (2. It is 
recognized that since Q is symmetrical, the matrix is also symmetrical. 
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It may be noted that the transformation expressed by Eq. 25 is very 
similar to the collineatory transformation given by Eq. 167 of Ch. III. 
The two transformations become identical if the matrix C is an orthogonal 
one, that is, if the transformation 16 relates the co-ordinates Xi • ■ Xn 
in a given rectangular co-ordinate system to the co-ordinates x'l — • x'n 
in another rectangular co-ordinate system with the same origin. This 
conclusion is recognized from the fact that for such a transformation 
Ct = (orthogonality condition). 

Moreover, since the determinant of an orthogonal matrix has the 
value dbl (see Art. 6, Ch. II, and Art. 4, Ch. Ill) it is clear that for this 
kind of co-ordinate transformation the determinant of the matrix is 
equal to that of Q. In other words, the discriminant of a quadratic form is 
invariant to an orthogonal transformation of its variables, 

4. The principal axes of a quadric surface; the reduction 

OF A QUADRATIC FORM TO A SUM OF SQUARES; DEGENERACY AND 
RANK 

The quadric surface defined by Eq. IS, although central, does not 
have its principal axes (like the major and minor axes of an ellipse) 
coincident with the axes of the reference co-ordinate system (the set of 
rectangular axes on which the components • • • acn of the vector x are 
projected). If they were coincident, only the square terms in Eq. 2 
would be present. The presence of the cross-product terms means that 
the principal axes of the quadric surface have arbitrary orientations in 
space relative to the directions of the reference axes. 

It is a common problem in analytic geometry to determine the orienta¬ 
tions of the axes of the quadric surface defined by Eq. 15 when the 
function F is given in the form of Eq. 2. If these directions can be found 
and chosen as the axes of a new co-ordinate system, a change of variables, 
wliich amounts to a transformation to these new co-i:)rdinates, should 
have the effect of eliminating the cross-product terms from the expression 
for F. 

Thus the geometrical problem of finding the principal axes of a quadric 
surface is seen to be essentially the same as the algebraic problem of 
reducing an arbitrary quadratic form to a sum of squares. 

According to the vector interpretation given in Art. 2 of this chapter, 
the quadric surface is generated by all possible ac-vectors whose scalar 
products with their transforms y have the fixed value unity. For any 
given direction of the vector x, its length is the distance from the origin 
to the surface. If the direction is along a principal axis, this distance is 
evidently a maximum or a minimum as compared with the distances for 
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any neighboring directions* This fact forms a convenient basis for finding 
the principal axes, since it reduces the task to a maximum-minimum 
problem. 

The square of the length of the vector x is given by the expression 

xi^ + X2^ + ■ ■ ■ + x^ [26] 

Since the maxima and minima of the length of x are coincident with those 
of the square of this length, there is no need to take the square root of the 
expression 26. In order that this length may represent the distance from 
the origin to the quadric surface, however, the variables Xi ■ • • Xn must 
satisfy the equation 

F = 1 [27] 

in which F is given by Eq. 2. 

According to the usual procedure for finding maxima, the expression 
for one of the variables obtained from Eq. 27 is to be substituted into 
Eq. 26, and the resultant function made a maximum or m i ni m um by 
setting its partial derivatives with respect to the remaining variables 
equal to zero. Obviously, this undertaking is exceedingly awkward in 
view of the complicated form of the function F. Hence in problems of this 
sort a slightly altered procedme, known as the method of determining 
conditioned maxima (or minima), is adopted. 

Thus it is said that the function 26 is to be made a maximum subject 
to the condition imposed by the auxiliary relation 27. The procedure is 
to form the function 

fixu • • ■ Xn) = Xi^ + X2^ ^ -h - H(F - 1) [28] 

in which H is an arbitrary constant (called a Lagrangian multiplier). 
In view of Eq. 27, this function is evidently the same as or rather it 
should be said that the function 28 becomes the same as \x\^ when the 
condition 27 is fulfilled. 

The partial derivatives Xn) equated to zero, that is 

^ = 0 for A = 1, 2, ... » [29] 

yield n equations. Together with the condition 27, these may be solved 
for the multiplier H and the special values of Xj - • • «n which yield the 
desired conditioned maximum. 

*This drcximstance is readily visualwied in the case of an ellipsoid, for which all these 
distances are real. For the moment, the geometrical interpretation may be confined to this 
type of surface, although the results of the present discussion, as appears later on, are not 
restricted to ellipsoidal quadric surfaces. The discussion in Art. 10 deals further with this 
question. 
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Fonning the partial derivatives in £q. 29 for the function expressed 
by Eq. 28 gives 

_ ..dF - 
2xi — H —— — 0 

dXi 


2*2 - H = a 

dxg 


[30] 


2*„-h|^ =0 

dXn 

If the values for the partial derivatives of F given by Eq. 9 are substituted, 
these equations become 

+ ®12*2 + * • • + OlnXn = 

021*1 + 022*2 + • • * + 02 n*n = ^*2 


Onl*l "I" On2*2 "1“ ' ' * "f" Onn*» — X*n 


[31] 


in which 


H 


[32] 


On the other hand, if Eqs. 30 are multiplied by Xi,X 2 , • ■ • x„ respectively 
and added, Eq. 10 being noted, there results 

(ri* + r2^ + • • • + x„^) -HF = 0 [33] 

and in view of the condition 27, this yields 

H = (*1® + *2^ H-+ Xn^) = 1*|2 [34] 

Equations 31, 32, and 34 together represent the solution to the maxi¬ 
mum-minimum problem. The results are seen to be extremely interesting, 
since Eqs. 31 are recognized as the conditions for which the direction of 
the vector * is left unchanged by the linear transformation 1, as dis¬ 
cussed in Art. 10 and 12, Ch. III. The results of the present problem, 
therefore, yield an alternative geometrical interpretation for these 
directions, namely: The principal axes of the quadric surface defined by 
Eqs. 2 and 15 together are those directions in space which are invariant to 
the symmetrical transformation 1. 

According to the discussion in Art. 10, Ch. Ill, the direction cosines 

of the principal axes are, therefore defined by Eq. 147 of that chapter, 
« 

in which the are the cofactors of the elements of the determinant in 
Eq. 146 for the latent roots X.. Each latent root defines a corresponding 
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principal axis, and the modal matrix £, given by Eq. 151, yields the 
directions of the complete set of n principal axes. 

Since in the present discussions the matrix (2 of the transformation 1 
is symmetrical, the modal matrix £ is orthogonal, as shown in Art. 12, 
Ch. III. In other words, the principal axes of the quadric surface form a 
mutually orthogonal set. 

According to liq. 32, there are n values for the Lagrangian multiplier 

H. = ^ [35] 

corresponding to the n latent roots of the matrix Q. The quantities Hi, 
H 2 , • • • Hn, which are the reciprocals of the latent roots, are called the 
proper values (eigenwerte) of the matrix Q or of the corresponding quad¬ 
ratic form F. Since the latent roots for a symmetrical matrix are real (as 
shown in Art. 12, Ch. Ill), it is seen that the proper values of the quad¬ 
ratic form F are real also. 

An interesting geometrical significance of these proper values is given 
by Eq. 34, which, for a particular vector x appropriate to the root Xa, 
reads 

Ha == q- . . . Xr?) = \x\^ [36] 

and hence represents the square of the length of the corresponding 
principal axis extending from the origin to the quadric surface. These 
lengths are commonly referred to as the semiaxes of the quadric surface. 

This result yields a geometrical interpretation to the latent roots of a 
symmetrical matrix. They are the reciprocals of the squares of the semiaxes 
of the associated quadric surface. If the latter is ellipsoidal, the lengths of 
all the semiaxes are real, and the squares of these lengths are positive. 
The quadric surface is, therefore, ellipsoidal when all the latent roots of 
the matrix S are positive. The apj^earance of negative roots indicates 
that some oi the lengths of the semiaxes are imaginary and hence that the 
surface has hyperbolic as well as ellipsoidal characteristics. If all the roots 
are negative, the surface is an imaginary ellipse, but it is customary to 
include tliis in the classification of completely ellipsoidal surfaces. In 
any case, the above maximum-minimum problem deals only in real 
values, since the square of the length of the vector x rather than its length 
enters into the manipulations.* 

If the principal axes of the quadric surface are chosen as a new co¬ 
ordinate system, and if the variables x\ • • • x'n refer to this system, the 
co-ordinate transformation from the original variables to the new 
variables x'k is given by the matrix equation 

x] = £x'] [37] 

*The discussion in Art. 10 is also relevant to these matters. 
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According to Eqs. 16 and 25, the matrix of the quadratic form F for the 
new variables is 


X Q X £ 


But by Eq. 208 of Art. 12, Ch. Ill, this is the diagonal matrix 


A=£tXQx£ = 


0 


0 0 •• • 0 I 

X2 0 • • • 0 


LO 0 • • • J 


[38] 


[39] 


Hence the quadratic form F expressed in terms of the new variables 
x'k reads 

F = x\ 

= + . . . + X„:cV [40] 

2 


*'i! + eV 

H, ^ H, 


+ 


Hn 


Equated to unity, this is the equation of the quadric surface in the 
rectangular co-ordinate system which is coincident with the principal 
axes of that surface. It is referred to as the normal form for the equation 
of the surface. At the same time, Eq. 40 represents the reduction of the 
quadratic form F to a sum of squares. 

This reduced form for F, together with the geometrical interpretation 
of the process of reduction, now yields a basis for interpreting the sig¬ 
nificance of the occurrence of zero roots or coincident roots to the char¬ 
acteristic equation of a symmetrical matrix. Thus coincident X-roots 
evidently indicate a certain degeneracy of the associated quadric surface. 
For example, in three dimensions a coincidence of two of the latent roots 
in the case of an ellipsoid results in an ellipsoid of revolution, whereas for 
a coincidence of all three latent roots the ellipsoid of revolution degener¬ 
ates into a sphere. 

When two of the latent roots are coincident, it thus becomes clear from 
the discussion of simultaneous homogeneous equations in Art. 7, Ch. Ill, 
that the characteristic matrix ((2 — X^), with X equal to the value of 
the coincident root, must have the rank w — 2. 

This reduction in rank of the characteristic determinant is required 
because a repeated nonzero X-root would otherwise suggest that in¬ 
trinsically less than n independent axes were required to describe the 
associated quadric surface. In other words, there would be less than n 
independent directions for which the vector describing the quadric 
surface goes through extrema. It is geometrically clear, however, that in 
the case of repeated nonzero X-roots, the quadric surface still occupies 
intrinsically n dimensions in space, and therefore requires n independent 
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axes to describe it. Although the symmetry resulting from the equality 
of the lengths of two or more of the semiaxes of the surface means that the 
directions of these semiaxes are not unique, it must nevertheless be pos¬ 
sible. to pick correspondingly two or more indep>endent (in fact, orthog¬ 
onal) directions along which one may assign axes to describe the surface. 
Hence if there are p repeated nonzero X-roots in a symmetric matrix 
describing a quadric surface in n dimensions, it must somehow be possible 
to find exactly p independent, but not necessarily unique, solutions for the 
X corresponding to the repeated root. This fact requires that the char¬ 
acteristic matrix have rank n — p ior the value of X in question. Under 
such circumstances the discussion in Art. 10, Ch. Ill, gives the procedure 
for finding such a set of n directions, and the corresponding nonsingular 
modal matrix £ which describes them. It is necessary to point out, 
however, that this geometrical discussion based upon quadratic forms is 
valid only for s)nnmetric matrices, and, as pointed out in the article 
mentioned above, it is not possible to extrapolate the conclusions thus 
drawn regarding coincident X-roots to the general case of nonsymmetric 
matrices.* 

When the matrix Q. of the transformation 1 is singular—more specifi¬ 
cally, if the rank of the matrix Q. is n — p — it is possible to satisfy 
Eqs. 31 in /^-independent ways for X = 0, which means that p of the 
latent roots are zero, and the corresponding p proper values H, (squares 
of the semi-axes of the quadric surface) are infinite. Equation 40 for the 
quadratic form F then has only n — p terms, and the associated quadric 
surface is again degenerate, but in a way somewhat different from its 
degeneracy in the case of repeated nonzero roots. For expnple, a three- 
dimensional ellipsoid of rank 2 (the matrix <2 has the order 3 and the 
rank 2) is an elliptic cylinder because one of its semiaxes is infinite. It is 
still possible to find a nonsingular modal matrix £ which reduces the 
original matrix to diagonal form because of the fact that p independent 
vectors x may still be found for X = 0. The procedure is exactly that 
described in Art. 7, Ch. Ill, and corresponds to the method used for 
nonzero repeated X-roots. Moreover, the converse of the present state¬ 
ment is also true; namely, that the occurrence of a zero X-root of order p 
in a symmetric matrix of order n requires that the rank of the matrix be 
exactly n — p. The geometric reasoning substantiating this assertion is, 
again, that it must be possible to find n dimensions intrinsically occupied 

* In general such a nonsymmetric matrix cannot be reduced to diagonal form by a col- 
lineatory transformation, since no nonsingular modal matrix may be found. An indication of 
what can be done by way of reduction may be found in G. Birkhoff and S. MacLane, A Survey 
of Modern Algebra (New York: The Macmillan Co., 1941), pp. 307-308, or R. Courant and 
D. Hilbert, Methoden der maihematischen Physik (Berlin: Julius Springer, 1931), Vol. I, Ch. I, 
pp. 36-37. 
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by the surface, even if p of them merely indicate co-ordinates upon which 
the function describing the surface is actually not dependent. 

Thus it may be stated that a given quadratic form of rank r, when reduced 
to a sum of squares^ contains r terms. That is, the new variables x\ - • • x\ 
are only r in number whereas there are n original variables x^ - • 'X^^ 
This result agrees with the geometrical interpretation because the descrip¬ 
tion of an elliptic cylinder, in the normal form for example, requires 
only two variables inasmuch as the function describing the cylinder is 
independent of the longitudinal dimension. 

S. A RELATED ]^XIMUM-MI3miUM PROBLEM 

A problem complementary to that treated in the preceding article is to 
determine the maxima or minima of the quadratic form F subject to the 
condition 

H-1- = 1 [41] 

imposed upon its variables. Here the function 

f{xi, • • • x„) = F - X(xi=* + xa® H- hXn^ - 1) [42] 

in which the Lagrangian multiplier is denoted by X, represents the 
quadratic form provided the condition 41 is fulfilled. 

The partial derivatives of f(xi, * • • Xn) equated to zero are 

dF 

7 - 2\Xk = 0 for A = 1, 2, • • •» [43] 

dXk 

In view of Eq. 9, these again yield Eqs. 31. Multiplying Eqs. 43 respec¬ 
tively by Xi,X 2 ,--- Xn, adding them, and noting Eq. 10 gives 

F - \(Xi^ + ^2^ + • • • + Xn^) = 0 [44] 

Because of the condition 41, this is 

F = X [45] 

The conclusion is that the maxima or the minima of the quadratic 
form F, subject to the condition 41, occur for values of the variables 
defining the vectors x whose directions are invariant to the linear trans¬ 
formation 1. Equation 45 shows that the corresponding maximimi or 
minimum values of the quadratic form are equal to the latent roots of 
its matrix, that is, 

Fmax = X, (s = 1, 2, • • • «) [46] 

min 

In the present instance, the quadratic form F is not restricted to a 
constant and hence cannot be said to represent a quadric surface at all. 
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The tip of the vector y, on the other hand, does trace out a quadric sur¬ 
face as a result of Eq. 41 and the relation 18 between x] and y]. The 
extrema of or the squares of the semiaxes of this surface, are given 
by the reciprocals of the latent roots of its matrix (Art. 4 of this 
chapter). But, by reason of the thoughts underlying the proof of the 
Cayley-Hamilton theorem (Art. 11, Ch. Ill), these roots are the recip¬ 
rocals of the squares of the latent roots of Q. Hence the extrema of \y\, 
or the semiaxes of the associated quadric surface, are just the latent 
roots X, of Eq. 46. Thus the quadric surface associated with the trans¬ 
formation 1 may be alternatively thought of as the locus of the tip of the 
vector y, when the tip of the vector x is restricted to lie on the surface of 
an M-dimensional sphere, Eq. 41. The semiaxes of this surface may how¬ 
ever be calculated in both magnitude and direction from the present 
conditions yielding the extrema of F subject to the condition 41. It is 
of interest to observe in this connection that the surface in question is 
always ellipsoidal, regardless of the nature of the nonsingular matrix <2. 


6. An interesting application of these results 


In view of the results of this alternative maximum-minimmn problem, 
a further particular question may be answered regarding the transforma¬ 
tion 1. In addition to inquiring whether it is possible for the transform of 
X to be zero, or to have the same direction as x, one may ask: Is it possible 
for the transform of x to be a vector at right angles to x? In other words, 
under what conditions is the scalar product x ■ y zero when neither x nor 
y is zero? 

It is shown by Eq. 14 that this scalar product is equal to the quadratic 
form F. Hence the present question amounts to inquiring whether 7 
may vanish for a nonzero vector x, that is, for 

* 1 “ + *2^ H- \- = k 9^0 

In the particular application to be considered, it will suffice to find th. 
answer to this question for the special case in which the quadratic form F 
is positive definite (cannot go negative). Under such conditions, the places 
where F becomes zero are clearly minima of the quadratic form, and the 
question originally asked is equivalent to asking for the conditions under 
which a stationary point of F shall occur for F = 0.* 


•In the case where F is not a positive definite form, it is not necessary for its zeros to occur 
at stationary points (subject to condition 47). The example F ~ xi^ — illustrates the 
point in question, when coupled with the condition ^ 0. F is zero only when 






- ) and the corresponding values of y] are ■ 


« - • The stationary points 


of F are, however, at xi = 0, == k and x\ = 0, x^ = k. Corresponding values of F and yl 

are y 2 ~ 0, = k and yi == 0, y 2 ^ = while F = k and F = — Jfe, respectively. 
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If, then, condition 47 is substituted in place of Eq. 41, the above 
analysis remains essentially unaltered. In particular, Eq. 45 is replaced by 

F ^k\ [48] 

The answer is that F may be zero ior k jA 0 only when one or more of 
the latent roots are zero. The occurrence of a zero root means that the 
matrix Q is singular. If at the same time Eqs. 1 are to have solutions for 
a nonzero y-vector, the latter must be a member of the transposed vector 
set of (2, which is the same as the vector set of (2 since (2 is symmetrical. 
Although the vector x constituting a solution is orthogonal to y, it is not 
simultaneously orthogonal to all the vectors in the set of (2, since y would 
then necessarily be zero.* 

A useful application of these thoughts is to the problem of determining 
whether a given vector set is linearly dependent or independent. The 
m vectors in an ^-dimensional space, expressed in terms of 

their components, yield the nonsquare matrix 

[ ^11 2^12 • * • 

. [49] 

^m2 * * * ^mnj 

for which it is to be assumed that m < n. 

To determine whether this vector set is linearly dependent or not re¬ 
quires, according to the discussion in Art. 2, Ch. Ill, that all m-square 
determinants be formed from the matrix 49 by selecting m columns in all 
possible combinations. The linear dependence of the vector set is estab¬ 
lished only if all these determinants are found to be zero. 

A considerably less laborious procedure is the following. The vector 
set is linearly dependent if there exists a relation of the form 

+ X 2 V 2 H-h XmVm = 0 [50] 

in which at least one of the coefficients Xk is not zero. The latter condition 
may be replaced by the requirement that 

*1^ + *2^ H-h = 1 [51] 

which is neither more nor less binding than to require that at least one of 
the ajjt’s be other than zero. 

The quadratic form obtained by forming the scalar product of the 
vector expression in Eq. 50 with itself may be written 

n 

F = {xiVi + X 2 V 2 H-1- x„Vm)^ = {vi ■ Vk)xiXk ^ 0 [52] 

»,fc=i 

Fulfillment of Eq. 50 requires that the quadratic form F be zero. Hence 

*These matters are discussed in Art, 7, Ch. III. 
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if the given vector set is linearly dependent, it must be possible to find 
F = 0 subject to the condition vSl. In other words, one of the latent roots 
of F must be equal to zero. According to the previous discussion this fact 
requires that the discriminant of the form 52 be zero; hence that 


Vi 

• n 

Vi 

. 2)2 • ■ 

-Vi 

■ 



V2 ' 

■ n 

V2 

. 2)2 • ■ 

. . 2)2 . 

• Vm 

= 0 

[53] 


• 


. 2;2 * 

• • Vm 

• Vm 




Thus the vanishing of only a single w-square determinant (called the 
Gramian determinant) need be investigated in order to establish the 
dependence or independence of the given vector set. 

7. Alternative reductions 

From the discussion in Art. 4, it should be clear that the reduction of 
a quadratic form to a sum of squares is identical with the transformation 
of its square matrix to the diagonal form. The latter problem is discussed 
in Art. 10, Ch. II, where it is shown that when the matrix Q is sym¬ 
metrical, reduction of it to a diagonal matrix 3) is accomplished by the 
congruent transformation 

X G X S = 3) [54] 

in which S is a nonsingular matrix, expressible as the product of ele¬ 
mentary transformation matrices. 

According to Eqs. 16 and 25, it is clear that the corresponding trans¬ 
formation from the variables Xi ••• Xn to the new variables x'l • • • x'n 
is given by 

x] = Six'] [55] 


Hence if the diagonal matrix is written 



dll 

0 

0 

••• 0 “1 

3) = 

0 

^22 

0 

... 0 


_0 

0 




[56] 


then the quadratic form F, Eq. 2, expressed in terms of the new variables, 
reads 

F = + d22x'2^ + • • • + d„„x'„2 [57] 

More generally, if the rank of the matrix Q (rank of the quadratic 
form) is r, the diagonal matrix 3), after suitable arrangement of its rows, 
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has the form 


0 0 . 0 

0 ^ • • • ... Q 


£D = 


0 0 
0 0 


drr • • • 0 

• • • - • • 0 


0 0 


... 0 


and the reduced quadratic form has r terms; thus 

F = diix\^ + d22^' + • • • + drrX^^ 


[58] 


[59] 


The matrix (2, however, possesses no unique diagonal form. According 
to the procedure given in Art. 10, Ch. II, there are any number of trans¬ 
formation matrices which can take the place of S in Eq. 54 and also 
effect a reduction of (2 to a diagonal form. For example, another non¬ 
singular matrix may be found such that 

X G X ^P = 2)' [60] 

in which 2)' is also a diagonal matrix. The transformation of variables 
leading to Eq. 60 may be represented by a relation similar to Eq. 55, 

rx:] = 2>a:"] [61] 

Correspondingly, there are any number of reduced forms for F, such as 
the one given by Eq. 59. 

In this connection it is important to note, however, that if the rank of 
the matrix (2 is r, all the diagonal matrices to which it may be reduced 
by a transformation of the form given by Eqs. 54 or 60 have the same 
number of nonzero diagonal elements (namely r), because all the trans¬ 
formation matrices, 2, 2^, • • • etc., are nonsingular. Consequently, all 
various diagonal matrices are equivalent to (2, and equivalent matrices 
have the same rank (see Art. 9, Ch. II). 

Not only do the diagonal matrices 2) and 2)' have the same number of 
nonzero elements, but they must have the same number of positive 
elements as well. This important property may be demonstrated by first 
assuming the contrary, and thereby arriving at a contradiction. 

Since the variables x''\ and a:"] are uniquely related to the original 
variables by nonsingular transformations 55 and 61, respectively, the 
quadratic forms resulting from the diagonal matrices 2) and 2)' must be 
identically equal for all corresponding values of x''\ and a:"]. If the. 
elements of £D are now written di, and those of 2)' are written J'*, the 
identity mentioned above becomes 

d\{x\Y + • * • + dy^{x\Y + dy,^i{x\j^iY + • • * + dr{x\Y = 
d\{x'\Y + • • • + d\{x'\Y + + * • • + d\{x'\Y [ 62 ] 
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Let the notation be chosen so that the first ^ terms in 3) and the first v 
tenns in 3)' are the positive elements in these matrices. The assumption 
that one of these numbers is greater may be stated by requiring either 
/z > or I' > It is again merely a matter of notation to assume p < 
The following special choice of variables in Eq. 62 is now 

made: 


^ M+l ”■ ^ P+2 — • 
X I = X 2 = * * 


• • = rr'n = 0 
. = x'\ = 0 


[63] 


In terms of the original variables x] in Eqs. 55 and 61, the conditions 63 
yield p + (n — jjl) < n equations in n unknowns. It is then surely possible 
to find a solution for x] in which not all the variables are zero (Art. 7, 
Ch. III). Moreover, the fact that iP and S are nonsingular means that 
values of x"p^i • • • x"n and x'l • • x'^ exist such that neither all the x'^i 
nor all the x'i are zero. These special values of x'] and x"] are now sub¬ 
stituted into Eq, 62, and the fact that di, • • • , > 0 while • • • , 

d'r < 0 is emphasized by using absolute values of the latter. The identity 
62 then becomes the equation 

diix'i)^ H-f- = -|d',+iI)2 - \d\\{x''r)^ [64] 

The result 64 is clearly impossible, since the left side is definitely greater 
than zero and the right side cannot possibly be greater than zero. It is 
therefore necessary to conclude that p = fx^ since the assumption of an 
inequality leads to the contradiction in Eq. 64. 

All the various reduced forms for F, like the one given by Eq. 59, 
therefore, have two things in common regardless of how this reduction is 
accomplished. The total number of terms is always equal to the rank r, 
and the numbers of positive and of negative coefficients are always alike. 
This result is known as the law of inertia of quadratic forms. 

If the number of positive coefficients in a reduced form is denoted by 
P, and the number of negative ones by N, evidently 

r^P + N [65] 

The difference 

P -N [ 66 ] 


is called the signature of a quadratic form. Both the rank and the signa¬ 
ture are thus seen to be invariant to the congruent transformation given 
by Eq. 25, in which C is any real nonsingular matrix. 

Although there are any number of matrices like S, £P, • • •, etc., which 
reduce the matrix Q to a diagonal form and P to a sum of squares (ac¬ 
cording to the congruent transformation 54 or 60), there is essentially 
only one orthogonal matrix which effects such a reduction, namely the 
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modal matrix £ defined in Art. 10, Ch. III.* Only for this orthogonal 
matrix do the coefficients of F in its reduced form equal the latent roots 
of (2. In other words, if the elements dn, ^ 22 ? * * * ^nn in the reduced form 
given by Eq. 57 are equal to the latent roots Xj, X 2 , * ■ • X^ respectively, 
the matrix S in Eq. 54 is the orthogonal modal matrix £. 

The congruent transformation, which applies to the transformation of 
the variables in a quadratic form (as discussed in Art. 3), should not be 
confused with the collineatory transformation discussed in Art. 10, 
Ch. III. Since the matrix (J of a quadratic form is symmetrical, its modal 
matrix £ is orthogonal (as shown in Art. 12, Ch. III). The collineatory 
transformation £”’^G£, which carries (J over into the diagonal form of 
its latent roots, is then identical with the congruent transformation 
£/Q£, because the transpose and the inverse of an orthogonal matrix 
are the same. 

However, if the columns of £ are multiplied by arbitrary nonzero 
factors, the collineatory transformation still accomplishes the same 
result (as pointed out in Art. 10, Ch. Ill), but the matrix obtained by 
this modification of £ is no longer orthogonal, and a congruent transforma¬ 
tion of Q by means of it does not reduce (2 to a diagonal form and hence 
does not reduce the corresponding quadratic form to a sum of squares. 

Thus when a collineatory transformation reduces the symmetrical 
matrix (2 to the diagonal form of its latent roots, the matrix effecting 
this reduction is not necessarily an orthogonal one (as in the case of a 
congruent transformation), but may be an orthogonal matrix post- 
multiplied by an arbitrary nonsingular diagonal matrix. 

8. Definite quadratic forms 

If all the coefficients dkk in the reduced form for F are positive or all 
negative, it is evident that the quadratic form is positive or negative 
respectively for all possible nonzero values of the variables. This result 
is true whether the variables are the x\ appearing in the reduced form 
or the Xk related to the variables x\ by a nonsingular transformation 
like Eq. 55, because this transformation amounts merely to a change in 
notation. Such quadratic forms are referred to as being either positive or 
negative definite. 

If a quadratic form is positive definite, all the latent roots of its matrix 
are positive. Conversely, if all the latent roots are positive, the quadratic 
form must be positive definite. Incidentally, it is worth noting in this 
connection that the quadric surface of a positive definite form must be 
ellipsoidal. 

*The only freedom in the construction of the matrix £ occurs when there are repeated 
latent roots, and the directions of some of the principal axes of the corresponding quadratic 
form are not unique. 
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When the quadratic form is positive definite, so that all the coefficients 
dkk in Eq. 59 are positive, the further congruent (real) transformation 


t ^ k 

X k — 


(for k = 1, 2, • • • r) 


evidently reduces F to the so-called canonic form 


[67] 


[ 68 ] 


in which all the coefficients are +1. The requirement that F be positive 
definite is necessary in order that the transformation given by Eq. 67 be 
real. Hence the statement: A positive definite quadratic form {singular or 
nonsingular) may always be reduced to the canonic form, given by Eq, 68, 
by means of a real nonsingular congruent transformation. 


9, A CRITERION FOR POSITIVE DEFINITENESS 

If the quadratic form given by Eq. 2 is positive definite, it is readily 
seen that regardless of its rank, none of the diagonal elements of its 
matrix can be either negative or zero. For, if Okk were such a zero or 
negative element, then setting all the variables except Xk and Xi equal to 
zero, and letting nCj = 1, would give the form the value 

F = an “I- 2aikXk “h (^kkXj? [6^] 

which, for akk ^ 0, can certainly become negative by a suitable choice 
for the value of Xk^ Although the condition 

akk > 0 [ 70 ] 

is a necessary one for positive definiteness, it is not sufficient. 

A useful set of necessary and sufficient conditions may be found 
through the following method of representing a positive definite quadratic 
form as a sum of squares. If the quadratic form is assumed to be non- 
singular and positive definite, the canonic form reads 

F = x\*^ + -j- . . . j'yjj 

and the variables x\ • • x\ must be related to the variables Xi^ • • Xn 
by a linear transformation such as 

^ 11^1 + P\2X2 + - • • - 4 - pinXn = x\ 

p 2 lXl + P 22 X 2 + • - • + p2nXn = x '2 j-y 2 j 

PnlXy "h P712X2 -j- • * ‘ ”h PnnXft ^ X n 

The matrix of this transformation is restricted only by the condition 

that it be nonsingular and real; that is, the coefficients pik must be real 
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numbers. In matrix form, Eqs. 72 read 

9x] = *'] [73] 

and hence 

F = ^x'] = X S^x] [74] 

Identifying this result with Eq. 21 for F. it follows that the matrix Q is 
given by 

a = 9tX 9 [75] 

If pi\ p 2 *, ■ ■ ■ pn represent the transposed vector set of 9, Eq. 75 
shows that the elements of the matrix (1 are given by the scalar products 

aik = pi • pk [76] 

It thus becomes clear that the elements of the matrix of a nonsingular 
positive definite quadratic form are necessarily determined from a 
linearly independent set of vectors in a manner similar to that which 
yields the elements of the Gramian determinant given by Eq. 53. The 
sufficiency of this conclusion is appreciated from the fact that if, for a 
given matrix (2, a nonsingular matrix 9 satisfying Eq. 75 can be found, 
the transformation of variables given by Eq. 73 reduces the equations 
having the matrix Q (Eqs. 1) to a set of identities. That is, 
== ^ (the unit matrix of like order), and all the diagonal 
elements of ^ are +1. The existence of such a matrix is thus recognized 
to be the necessary and sufficient condition for the positive definiteness 
of the quadratic form associated with the nonsingular matrix (2. 

Incidentally, it may be noted that the elements of the matrix @ of the 
fundamental metric tensor (see Art. 5, Ch. Ill), are formed in a similar 
manner. The latter is, therefore, the matrix of a positive definite quadratic 
form. 

In particular, it may be observed that the elements on the principal 
diagonal of Q are given by 

O'kk = pk * pk = \pk\^ [77] 

These are equal to the squares of the absolute lengths of the vectors. 
According to the remarks made in the opening paragraph of this article, 
none of the vectors pk is, therefore, allowed to be zero. This, as well as 
the condition that the vector set pk be linearly independent, is assured 
by the requirement that be nonsingular. 

It should now be observed that the assumption of a more special form 
for the matrix if does not subject the above argument to any restrictions. 
Thus the vector pi in the transposed vector set of 9 may be assumed to 
be coincident with axis 1 of the rectangular reference system. The second 
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vector p 2 ^ is chosen to lie in the plane determined by the axes 1 and 2; the 
third vector is then oriented so as to be confined within the three- 
dimensional subspace determined by the axes 1, 2, and 3, and so on. 
This procedure in no way restricts the generality of the vector set 
P\ ' * * Pn\ but merely amounts to a particular orientation of the reference 
axes relative to the given vector set pk. 

The result of this choice of orientation for the reference axes is that 
pi has no components other than that on the axis \\ p 2 * has no com¬ 
ponents other than those on the axes 1 and 2, and so forth. The matrix ^P 
then assumes the special triangular fopn 


pll 

Pl2 

Pl3 * * * 

pin 

0 

P22 

pTS * * • 

P^n 

0 

0 

p33 * ‘ * 

P3n 

_0 

0 

... . 0 

Pnn^ 


The real nonsingular matrix 9 having this form, the problem now is to 
discover the conditions which are imposed upon the given matrix Q by 
the requirement that it shall have the representation expressed by Eq. 75 
(according to which its elements are given by Eq. 76). The most direct 
way of discovering these conditions is to proceed with a determination of 
the matrix for a given matrix (2. A possible procedure for this determina¬ 
tion is suggested by the method of reducing an arbitrary symmetrical 
matrix to a diagonal form by means of the congruent transformation 54 
(as discussed in Art. 10, Ch. II, and there expressed by Eq. 189). Ac¬ 
cording to this method, the matrix S effecting the reduction may have 
the same triangular form as £? in Eq. 78 if (as is true in the present 
problem) none of the diagonal elements in the given matrix Q are zero. 
The matrix S, moreover, has diagonal elements which are all +1. 

With reference to Eqs. 54 and 75 one may write 

a = Sr'3)2-' = [79] 

Since the inverse of the matrix 2 again has the same triangular form with 
diagonal elements which are all +1 (as may readily be seen from any 
method of matrix inversion, for example, the one discussed in Art. 6, 
Ch. II), the formation of the matrix ^ is made evident by Eq. 79. Thus, 
denoting by 3 )'^^ the diagonal matrLx whose diagonal elements are the 
square roots of the respective elements of 3 ), one has 

9 = 3 )'/^ 2 -' [ 80 ] 

The significant part about this result is that the diagonal elements of 9 
are those of 3 )'^^. The diagonal elements of 3 ), therefore, are the squares 
of the diagonal elements puy p 22 > * * * pnn of 9. The positiveness of these 
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squared elements is thus seen to be the necessary and sufficient condition 
for the positiveness of the diagonal elements in 9), and hence for the 
positive definiteness of the quadratic form having the matrix (2. It 
remains to express this requirement in the form of conditions upon the 
elements of the matrix Q. 

The determinant P of the triangular matrix in Eq. 78 is equal to the 
product (P 11 P 22 • • • Pnn) of its diagonal elements, none of which, because 

is nonsingular, is allowed to be zero. According to Eq. 75, the de¬ 
terminant A of the matrix (2 is 

A — — {p\\P22 ■ • • ^nn)^ [81] 

Now if the variable is set equal to zero, x'n (according to the trans¬ 
formation 73 and the special form of given by Eq. 78) becomes zero 
also. The quadratic form F then appears as a function of the variables 
Xi • • • Xn—i only, or in the reduced form as a function of the variables 
x'l ■ • ■ x'n-i only. The elements in the last row and column of the matrix 
(2 or of the matrix (P then have no further influence upon the values of 
F in Eq. 2, so that the latter may be regarded as a quadratic form in 
« — 1 variables with a matrix (2„_i obtained through striking out the 
last row and column in (2. Correspondingly, the last row and column in 
(P may be struck out, and the remainder denoted by iPn-i- If Pn-i is the 
determinant of £P,^_i and An-i that of (2„_i, the same reasoning as before 
shows that 

An—I = Pn—l^ = {P 11 P 22 • • • Pn—\}^ [82] 

In a like manner, through also setting x„_i, x„_ 2 , etc., equal to zero, 
it may be seen that the determinants An- 2 , etc., which are ob¬ 

tained by striking out the last two, three, etc., rows and columns in A, 
are given by 

An-2 — Pn-2^ = iPnp22 ’ ' * z)* 

A „—3 — Pn—3^ — {P 11 P 22 • • • Pn-a)^ 

Ai — ail = pii^ 

From these equations it follows that 

Pn^ =Ai= an 



[ 84 ] 
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The necessary and sufficient conditions that a nonsingular quadratic 
form F with the discriminant A be positive definite are, therefore, stated 
by the inequalities 

A > Oj An^i > 0, ^n—2 > 0, • • • i4i = dll > 0 [85] 

A nonsingular quadratic form is positive definite if the discriminant and all 
its principal minors have positive nonzero values. 

The relations 84 together with Eq. 76 afford a method for determining 
the triangular matrix of Eq. 78 whereby the quadratic form may be 
reduced to the canonic form given by Eq. 71. Thus the diagonal elements 
in are given by Eqs. 84 directly. Next, Eq. 76 shows that 

<^ik = pnpik for ^ = 2, 3, • • • » [86] 

from which the remaining elements in the first row of are determined. 
Using Eq. 76 again, one finds 

^2k = puplk + p22p2k fol* ^ = 3, 4, • • • W [87] 


Here p 2 k is the only unknown, and so the remaining elements of the second 
row of JP can be calculated. From 


<^Zk — Pvsplk + p22p2k + p33p3k ^OT ^ = 4 , 5 , • • • [ 88 ] 


in which pu is the only unknown, the remaining elements in the third 
row of iP are found, and so forth. 

If the quadratic form F is singular — more specifically, if its matrix Q 
has the rank n — p — then the criteria for positive definiteness are the 
same as those given by the relations 85 except that the equals sign is 
included with the first p inequalities. 

Thus if (2 is the matrix of a positive definite quadratic form of rank r, 
it may be reduced to its canonic form by means of a real nonsingular 
triangular matrix S in the congruent transformation 


1 0 0 0 ••• 0 
0 1 0 0 0 


a.aa = g = 


0 0 • •• 1 0 • • • 0 
00 0 


[89] 


00 ••• 0 


Here the canonic matrix g has r units ( + 1) on its principal diagonal. 
The matrix S has the same triangular form as in Eq. 78. 

The inverse of S again has the same triangular form, and hence may be 
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identified with 9 of Eq. 78, so that the singular matrix (2 is represented by 

a = [90] 

in place of Eq. 75, which holds only when S is nonsingular. 

Bearing in mind the form of the canonic matrix S as shown in Eq. 89, 
and applying the same reasoning as in the previous argument in which 
a is assumed to have the rank w, one may establish the above statement 
regarding the modification of the criteria 85 for any rank n -- p. 


10. The iterated quadratic form 


The quadratic form which results when the matrix a of F is replaced 
by the ^th power of a is referred to as the iterated form of ^th order, or 
as the Ath iterated form of F. If £ is the orthogonal modal matrix of a, 
as pointed out in Art. 11, Ch. Ill, 

£,a2£ = £,a££^a£ = [91] 


in which A is the diagonal matrix of the latent roots of a. 
Since 

0 0 • • . 0 “ 

^2 ^ 0 0 •.. 0 

^0 0 • • • 


[92] 


the latent roots of the second iterated form of F are equal to the squares 
of the latent roots of F, More generally, the latent roots of the ^th 
iterated form of F are recognized as being equal to the ^’th powers of the 
latent roots of F, 

It is also clear that the modal matrix £ which transforms F to its 
normal form (sum of squares) also transforms any of the iterated forms 
of F to their normal forms, and that the latter differ from the normal 
form of F only in that the coefficients of the square terms appear raised to 
the ^th power. 

It appears that all the iterated forms of even order are positive definite^ 
and that their associated quadric surfaces are entirely ellipsoidal in 
character. Moreover, the principal axes of these ellipsoidal quadrics 
coincide in direction with those of the surface associated with F, since 
the modal matrix £ defines these directions. 

Hence in searching for the principal axes of a quadric surface F = 1, 
it is immaterial whether the given form F or any of its iterated forms is 
considered. With regard to the method discussed in Art. 4, it is thus 
recognized that the argument is not subjected to any loss in generality by 
the assumption, for the purpose of clarifying the geometrical visualization, 
that the given quadric surface is entirely ellipsoidal in character. 
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H. The simultaneous reduction of a pair of quadratic forms 

TO SUMS OF SQUARES 

Two quadratic forms are considered to be given by the matrix equations 

Fi = [93] 

and 

F 2 = [94] 

In the present discussion, it is assumed that at least one of these forms is 
positive definite and nonsingular.* 

The fundamental principle upon which the simultaneous reduction is 
based is the following. If one of the forms, for example F 2 , is nonsingular 
and positive definite, the associated quadric surface may be visualized 
as that of an ellipsoid. The variables rri • • • of the two functions Fi 
and F 2 are first subjected to the orthogonal transformation which intro¬ 
duces the principal axes of this ellipsoid as a new co-ordinate system. 
This transformation reduces F 2 to a sum of squares but does not in 
general eliminate the cross-product terms from Fi also. 

A further real transformation of the form given by Eq. 67 next carries 
F 2 over into its canonic form, and the associated ellipsoid becomes a 
sphere. If F 2 were not nonsingular, the resulting quadric surface would 
not be spherical; and if F 2 were not positive definite, the transformation 
which reduces it to its canonic form would not be real. The resulting form 
Fi at this stage would then not be real either, and the following step 
could not be carried out by means of a real transformation. 

The equation of a sphere with its center at the origin is evidently in 
the normal form (sum of squares with coefficients unity) regardless of 
the angular orientation of the rectangular co-ordinate axes. Any set of 
orthogonal axes can be principal axes for the sphere. Hence the variables 
in both quadratic forms can now be subjected to any orthogonal trans¬ 
formation without further affecting the form of F 2 . At this step an 
orthogonal transformation can be found which reduces Fi to a sum of 
squares (transforms to the co-ordinates which are the principal axes of 
the quadric surface defined by the form which Fi has at this stage), and 
F 2 remains in its canonic form. 

A transformation which combines these three steps evidently accom¬ 
plishes the desired simultaneous reduction of both Fi and F 2 . This 

*In physical problems, quadratic forms usually represent energy functions, and hence this 
assumption does not constitute a serious restriction from the practical standpoint. The alge¬ 
braically more complicated problem which results when these re?trictions are not imposed, 
is not treated here (for an introduction to this more general problem the reader is referred to 
M. Bocher, Introduction to Higher Algebra (New York: The Macmillan Co., 1927)]. 
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reduction is now formulated explicitly by means of the following matrix 
equations. 

If Fz is positive definite and nonsingular, the discussion in Art. 9 shows 
that its matrix S may be represented by the relation 

SB = 9i9 [95] 

in which 9* is a nonsingular real matrix. This matrix may be considered 
to be any one which satisfies the congruent transformation 

9r^99-^ = SU [96] 

% being the unit matrix having the same order as £B. 

One method of finding 9 is to determine first the orthogonal modal 
matrix of SB which, by means of the congruent transformation 

= At [97] 

reduces SB to the diagonal form of its latent roots. This diagonal matrix 
is denoted by A 5 . Now if A{,*^^ represents a diagonal matrix with diagonal 
elements equal to the square roots of the latent roots of SB (none of which 
is zero), 

A-1/2£^(4)^<6)A^-»/2 == 6U pg] 

A comparison of Eqs. 96 and 98 yields 

9 = A 6 ^' 2 £^(W |-99j 

However, since 

^ [ 100 ] 

in which 0 is an arbitrary orthogonal matrix of the same order as and 

SB, it is readily seen that 9 may more generally be represented as 

9 = OtA 6 l' 2 £^( 6 ) 

The matrix 9 may be found by this method, or perhaps more simply 
by means of the process discussed in Art. 10, Ch. II. This part of the 
simultaneous reduction of Fi and F 2 is not unique and may be accom¬ 
plished by whatever procedure appears to be the most expedient under 
the given circumstances. 

If the variables a:i • • • *„ in the quadratic forms given by Eqs. 93 and 
94 are subjected to the transformation expressed by the matrix equation 

x] = 9-W] [102] 

the matrices of these quadratic forms are subjected to the congruent 
transformations 


9-IQ9-1 ^ am 


[ 103 ] 
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and 

£Pr^£B5P-‘ = CU [104] 

F-i is thus reduced to its canonic form. Fi at this stage has the matrix 
which evidently is still real and S 3 rmmetrical. Hence it possesses an 
orthogonal modal matrix which carries it over into the diagonal 

form of its latent roots; thus 

£^(a/6)Q(5)£(a/5) ^ (-JOSJ 

These roots are called the latent roots of Q. with respect to ffi. Since is 
symmetrical, these latent roots are real. They are positive if (2 (as well 
as ffl) is the matrix of a positive definite quadratic form (see Art. 7 of 
this chapter).* 

The further transformation of variables 

x'] = [106] 

with the orthogonal matrix leaves F2 in the canonic form 

F2 = + (*" 2 )" + • • • + {x"nr [107] 

and reduces Fi to the sum of squares 

Fi = + • • • + X„(»'«(a:"„)2 [108] 

in which are the latent roots of Q with respect to ®. 

These are the roots of the characteristic equation 

|(2(6) - xqil = \9r^ag>-^ - x^uj = o [io9] 

Since the latent roots of a matrix are invariant to a collineatory trans¬ 

formation (see Art. 10, Ch. Ill), and 

_ Qg>-ig>-i = QS-i [110] 

or 

cp-iQWcp ^ cp-icp-iQ = £g-iQ [ 111 ] 

it follows that the characteristic equation 109 may alternatively be 
written in either of the forms 

|(2£B-' - X%| = 0 [112] 

or 

- X^l = 0 [113] 

Since SB is assumed to be nonsingular, the equation 

|SB(SB->(2 - XGU)| =0 • [114] 

•This fact is an important one in the study of oscillating systems in dynamics and electrical 
network theory. 
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has the same roots as Eq. 113. Hence the latent roots of (2 with respect 
to SB may also be defined as the roots of 

\a - X£B1 = 0 [115] 

In other words, the characteristic equation for these latent roots may be 
written in any one of the four forms given by Eqs. 109, 112, 113, or 115. 

Since there are no restrictions on the symmetrical matrix G (except 
that it be real, of course), some of the roots of the characteristic equation 
115 may be negative, or coincident, or zero. Observe that Q and 
contained in Eq. 103 are equivalent matrices (because 9^ is nonsingular) 
and hence they have the same rank. Therefore, if the rank of the matrix 
a of Fi is r, the characteristic equation 109 or 115 has r nonzero roots, 
and the reduced form for Fi given by Eq. 108 has r terms. The canonic 
form for P2, however, must have n terms because the matrix of F 2 is 
assumed to be nonsingular. 

12. An alternative geometrical interpretation of the same 

PROBLEM 

So far in the discussions of this chapter, the various geometrical inter¬ 
pretations have assumed a rectangular co-ordinate system. Thus the 
equation F = 1 for the quadric surface associated with a given quadratic 
form is visualized geometrically by supposing the variables Xi • • • to 
be the co-ordinates of a point with respect to a rectangular system of 
axes. The normal form for this equation, for which F appears as a sum 
of squares with arbitrary real coefficients, is then familiarly recognized 
as yielding the quadric surface (ellipsoid, for example) with its orthogonal 
set of principal axes coincident with the co-ordinate axes. 

Although the tacit assumption of a rectangular co-ordinate system is 
quite in order, it is just as feasible to suppose that the reference co¬ 
ordinate system, which is used for the geometrical interpretations, is 
given by an oblique set of axes, but these interpretations must then be 
revised. 

First, in this regard, it is significant to observe that an ellipse, for 
example, remains an ellipse when the angle between the co-ordinate axes 
is allowed to depart from 90 degrees. The equation of the ellipse is 
supposed to remain fixed, and the co-ordinates xi and X 2 are then assumed 
to be the parallel projections of a point P upon the oblique axes; that is, 
they are the contravariant components of the vector OP (O denotes the 
origin) which is the vector sum of its components according to the familiar 
parallelogram law of addition. If the given equation is plotted by laying 
off corresponding values of Xi and X 2 along such a set of axes, the geo¬ 
metrical form of the resulting figure is still elliptic provided it is elliptic 
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when identically the same equation is plotted by la)dng off Xi and «2 
along a set of rectangular axes. 

Next, it should be noted that even if the equation of the central ellipse 
is in its normal form, the principal axes of the ellipse need not coincide 
with any of the oblique co-ordinate axes. This fact the reader may 
readily establish for himself by plotting a simple numerical example on 
oblique axes. In this connection it should be observed that the equation 
of a circle in rectangular co-ordinates represents an ellipse when plotted 
in oblique co-ordinates. 

According to the previous discussions of this chapter, the equation of 
a given central ellipse is transformed to its normal form by rotation of 
the rectangular co-ordinate system until it coincides with the principal 
axes of that ellipse. In view of the remarks of the present article, it 
appears that this reduction may alternatively be thought of as accom¬ 
plished through transforming to an oblique set of coK)rdinate axes whose 
angular orientations relative to the given ellipse are such as to yield this 
same ellipse by means of an equation which contains square terms only. 

It is significant to note that there are an infinite number of pairs of 
oblique axes for which the equation of an ellipse goes into the normal 
form. The distinguishing characteristic of a normal form is the property 
that a reversal of the sign of any particular co-ordinate of a point on the 
curve always yields another point on the curve. If any line through the 
center of the figure is chosen as one of the oblique axes, the other axis 
required to yield an equation for the ellipse in normal form is uniquely 
determined. The symmetry requirement mentioned above may be met 
if the second axis is chosen to be the one bisecting all chords of the figure 
parallel to the first axis. Such a pair of axes is known as a pair of conjugate 
diameters, and it is a property of these lines that each bisects all chords 
parallel to the other. It is this property which meets the symmetry con¬ 
dition characterizing a normal form in an oblique set of co-ordinates. A 
simple way to find the second axis, when any first axis is arbitrarily 
assigned, follows from the realization that the tangent to the ellipse at 
either end of the first axis is a limiting form for the set of parallel chords 
bisected by that axis. Hence the second axis is assigned to be that line 
through the center of the ellipse which is parallel to a tangent to the 
curve at the extremity of the first diameter chosen. 

The clue to the simultaneous reduction of two quadratic forms to 
sums of squares also lies in these ideas. Thus, if two ellipses are given (the 
two forms Fi and F 2 may for the moment be thought of as defining a pair 
of central two-dimensional ellipses) with arbitrary semiaxes and with an 
arbitrary relative orientation, it is possible to find a single pair of oblique 
axes such that both of the given ellipses may be described by means of 
equations which contain square terms only. 
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A sketch of any two such central ellipses will convince the reader that 
it is always possible to choose a first axis in such a way that tangents to 
both ellipses, at the points where this line intersects them, are parallel. 
The second axis is then taken parallel to these tangents, and in this set 
of oblique co-ordinates both ellipses have the symmetry propierty which 
indicates a normal form for the equations representing them. 

The feasibility of obtaining such a set of oblique axes in the general 
case is thus indicated, though the most expedient method of handling the 
problem analytically does not directly parallel the above geometrical 
discussion. 

With reference to the Eqs. 93 and 94 for the forms Fj and F 2 , these 
ideas are formulated more specifically by the statement that there exists 
an oblique co-ordinate system defined by the unit vector set Ci, C 2 , • • • c„ 
of the matrix <?, such that a transformation to the contravariant variables 
of this system (see Eq. 43, Art. 5, Ch. Ill) by means of the equation 

*] = [116] 

and its transpose 

.£ = i.e [117] 

simultaneously carries the expressions for these two quadratic forms 
over into 

Fx = [iis] 

and 

F 2 = [ 119 ] 

in which 3) 1 and 2)2 are diagonal matrices. 

The orientations of these oblique axes, defined by the vector set of the 
matrix C, are found in the solution to the following closely related problem. 
The linear transformations associated with the quadratic forms Fi and 
F 2 may be written 


a*] = y] 

[120] 

£B*] = z] 

[121] 


The first of these equations transforms a vector x into a vector y, and 
the second transforms the same vector x into a vector z. The question 
may be raised whether there are any particular directions for the vector x 
(relative to a fundamental rectangular co-ordinate system) for which its 
two transforms y and z are coincident in direction (but not necessarily 
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coincident with *). This condition is expressed by the matrix equation 

y] = Xz] [122] 

in which X is a constant multiplier. 

Substituting Eqs. 120 and 121 into Eq. 122 yields 

(G - Xffi)*] =0 [123] 

The question, therefore, amounts to inquiring whether nontrivial solu¬ 
tions may be found to the set of homogeneous equations 

(an ~ X6n)^i + (^12 - X&12)X2 ^-+ (a^ - \bxn)xn = 0 

(a2i — + (^22 ““ Xi22)^2 + ‘ ‘ + (^2n — X&2n)^n = 0 [^J24] 

(^nl 4” (^n2 XZ>7i2)^2 “f" * * * “f" (^nn = 0 


The condition for the existence of such solutions is that the determinant 
of this system of equations shall vanish, that is, 

|Q - Xffil = 0 [125] 

This is identical with the characteristic equation 115 which determines 
the latent roots of (J with respect to If the determinant of Eqs. 124 
for a particular root is written 

\a - XS|W«,„,. [126] 

S 

and the cofactors of the fth row of this determinant are denoted by kik, 
the direction cosines of a vector x constituting a solution appropriate to 
the root X = are given by 

a 

f*. = ' = foT k = 1, 2, • • ‘ tl [127] 

yliLr + + • • • + (L)" 


provided all the X-roots of Eq. 125 are distinct. 

For such a vector x with the components Xi, X 2 , • • • Xn relative to the 
fundamental rectangular co-ordinate system, Eq. 123 may be written 

Qi] = X.<“'^>£Bi] [128] 


The n equations of this form, for the n particular vectors i, I:, ■ ■ ■ x 
appropriate to the n roots of Eq. 125, may be combined into one matrix 
equation by definition of the modal matrix 


£ = 


I’ll ^12 
^21 ^22 


fin" 

f2« 


[129] 


L^i 


f»2 • • • / 


nn J 


the elements of which are the direction cosines defined by Eq. 127. Then 
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the complete set of equations like the one given by Eq. 128 is contained in 

= £B£Aa/6 [130] 

in which Ao/i, is the diagonal matrix of the latent roots of Q with respect 
to £B, that is, the same diagonal matrix as that appearing in Eq. 105. 

If Eq. 130 is premultiplied on both sides by the transpose of £, it reads 

£«(2£ = (£t£B£)Aa/6 [131] 

The resultant matrices £jQ£ and £(JB£ are necessarily symmetrical 

because Q. and are symmetrical. Equation 131 implies that after the 
columns of the symmetrical matrix £fffi£ are multiplied by a set of factors 
respectively, the resulting matrix is still symmetrical. 
This condition can be possible only if £<(3£ and £<£&£ are both diagonal 
matrices. Hence if these are written 

£<a£ = iZ), [132] 

and 

£jffi£ = ®2 [133] 

then a comparison with Eqs. 118 and 119 shows that the matrix C has 

been found, namely, 

e = £, [134] 

The direction cosines of the set of oblique co-ordinate axes, in terms of 
which the equations of the two quadric surfaces associated with the 
forms i'l and appear as sums of squares, are given by Eq. 127. More 
specifically, the direction cosines of the sth oblique axis are the elements 
in the 5th column of the matrix £ defined by Eqs. 127 and 129. The set 
of unit vectors characterizing the oblique axes with reference to the 
fundamental rectangular co-ordinate system is the transposed vector 
set of £. 

Equations 131, 132, and 133 show that 

Aa/fr = [135] 

or, if the diagonal elements in 3)i and 3)2 are denoted by and 
respectively, that 

X.<“» = [136] 

^88 

The quadratic forms Fi and F^ given by Eqs. 93 and 94 are, therefore, 
simultaneously reduced to 

Fl — -f- d22^^^f2^ + • • • + 


[137] 
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and 

F 2 = + . . . + 1-138] 

when the variables »i • • • *» are subjected to the linear transformation 

*] = £f] [139] 

The matrix £ is, of course, not orthogonal, as is clear from the fact that 
it defines a set of oblique axes or as is alternatively made evident from 
Eq. 130, which can be written 

£-^(£B-^(2)£ = Kalb [140] 

It thus appears that £ is the modal matrix which reduces the dissym¬ 
metrical matrix to the diagonal form of its latent roots. 

As shown in the previous article, these latent roots are real, but if d 
has the rank r, then » — r of them are zero. Since SB is nonsingular, none 
of the diagonal elements is zero, but Eq. 136 shows that as many 
elements of the diagonal matrix 3)i, are zero as there are zero X-roots in 
the characteristic equation 125. Thus the reduced form 137 has r terms, 
and that given by Eq. 138 has n terms. 

Since F 2 is positive definite, all the coefficients in Eq. 138 are positive. 
A further real transformation of the variables then carries and Fi over 
into the forms given by Eqs. 107 and 108 respectively. 

13. A FEW REMARKS REGjI^ING THE SIMULTANEOUS REDUCTION OF 
MORE THAN TWO QUADRATIC FORMS TO SUMS OF SQUARES 

In the solution of many practical problems, it would be very desirable 
to be able to reduce more than two quadratic forms to sums of squares 
simultaneously. To do so is in general not possible, however, as the reader 
can readily appreciate by considering an attempt to extend the reasoning 
in the opening paragraphs of Art. 11 or 12 to more than two forms. 

If p quadratic forms Fi, F 2 , • • • Fp are given, it is, however, possible 
to reduce them simultaneously in the special case for which there exist 
p — 2 independent relations of linear dependence of the form 

yiFi -|- 72^2 + ' •' + ypFp — 0 [141] 

in which at least one of the coefficients has a-nonzero value. The condi¬ 
tion 141 must, of course, hold for all values of the common variables 

xi - ■ ■ Xn. 

Cases of this sort which do occur in practice are the problems of reduc¬ 
ing the three forms Fi, F 2 , and F 3 , when 

Fi = 7F2 


[142] 
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or of reducing the four forms, Fi, F2, F3, F4, when 

Fi = yP2 

and 

Fz = 8^4 

Evidently, a transformation which carries Fi and F3 over into their 
reduced forms simultaneously yields a similar reduction for F 2 and F4. 

14. The abridgment of a quadratic form that results from 

IMPOSING LINEAR CONSTRAINTS UPON ITS VARIABLES 

Consider for the moment a quadratic form F in only three dimensions, 
and visualize its associated quadric surface defined by F = 1 as a central 
ellipsoid. If one demands that one of the three variables :ri, ^2, X 2 be zero 
(for example, if one arbitrarily sets = 0), it is clear geometrically that 
the ellipsoid thereby is reduced to the two-dimensional ellipse given by 
the intersection of the ellipsoid with the co-ordinate plane normal to 
axis 3, i.e., the 1-2 plane. This ellipse is defined by an equation F = 
1 in which F is obtained from F through simply dropping those terms 
involving Xz- 

The equation X3 = 0 may be regarded as a linear constraint which 
restricts the original variables to values corresponding to points on the 
intersection of the ellipse with the 1-2 plane, the latter being referred to 
as the constraint plane. F, which is a quadratic form in only two variables, 
is spoken of as an abridged form of F. 

The abridged form is not always so easily found as the very simple 
situation just described. Thus, with reference to the same three-dimen¬ 
sional form F, suppose that the constraint plane is chosen as an arbitrary 
one, still passing through the origin of co-ordinates, however. In this case 
the equation of constraint is changed from the simple form 0:3 = 0 to 

P^i^i + Pz2^2 + Pzz^z = 0 [144] 

If pzu Pz 2 y p 33 ^16 regarded as components of a vector pz, and Xi, X 2 , Xz 
as those of a vector Xj Eq. 144 demands that the vector x be orthogonal 
for the vector pz, which, in the simpler case considered above, is coincident 
in direction with co-ordinate axis number 3. The constraint plane is 
normal to the vector pz, and may be fixed at will through an appropriate 
choice of this vector. 

The abridged quadratic form F is such a function of two variables that 
F = 1 becomes the equation of the elliptic intersection of the original 
ellipsoid with the chosen constraint plane. Since the variables involved in 
F must refer to a two-dimensional orthogonal co-ordinate system lying 
within the constraint plane, it is clear that these variables are not simply 
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two of the original ones. To find F one must first determine a new set of 
orthogonal co-ordinate axes l', 2', 3', such that one of these, say axis 3', 
is coincident with the vector (normal to the constraint plane). The 
new axes l' and 2' will then lie in the constraint plane; and in terms of the 
new variables xi, X2, xs, referring to the new axes, it becomes clear that 
the constraint 144 is expressed by the simple relation xs = 0. The problem 
is thus reduced to the simple form considered above. The abridged form 
F is found by first subjecting the original variables in F to the orthogonal 
transformation appropriate to changing from axes 1, 2, 3, to axes l', 2', 3', 
and then dropping all terms involving x^. 

The crux of the procedure lies in finding the proper axes 1', 2', 3', and 
from these the appropriate orthogonal transformation. Since axis 3' is 
coincident with the vector defined by the constraint Eq. 144, the 
problem is essentially that of associating with this vector p^^ two other 
vectors pi and p 2 such that the three together form a mutually orthogonal 
set. To carry out this procedure, one would begin by finding first a vector 
p 2 normal to p^^ and then a vector pi normal to the other two. Since 
there exists an infinite number of vectors p 2 normal to />3, it is clear that 
the procedure as a whole is not unique, and there exists an infinite number 
of functions F of which any one may appropriately be called the abridged 
form of F for the stated constraint. 

The details of the procedure just described are best made clear through 
a numerical example. Suppose one has given 

F = xi^ + Ix^ -h 3x3^ [145] 

and the linear constraint 

^1 + ^2 + ^3 == 0 [146] 

Choosing F in the form of a sum of squares does not detract from the 
generality of the procedure to be discussed here. 

The constraint vector p^, has the components [1, 1, 1]. A procedure for 
finding vectors pi and p 2 such that the three vectors form a mutually 
orthogonal set may be patterned after the methods discussed in Art. 7, 
Ch. III. In this way the following matrix is readily found: 

"-1 -1 2 “ 

= 1 -1 a [147] 

.1 1 iJ 

the components of the vectors pi, p 2 , ps being defined, respectively, by 
the elements of the first, second, and third rows. As already mentioned, 
the determination of this matrix is not unique. It may readily be 
checked by inspection that the three rows of define a mutually orthogo¬ 
nal set of vectors. 
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Through dividing the components of each vector by the square root 
of the sum of the squares of its components (called normalization) one 
obtains a corresponding set of unit vectors, whose matrix is orthogonal 
(defines mutually orthogonal unit vectors by columns as well as by rows). 
This orthogonal matrix, which reads 


0 = 


"-0.408 
0.707 
0.577 


-0.408 0.817 
-0.707 0.0 
0.577 0.577 


[148] 


yields the desired transformation from the co-ordinates Xj, Xs to 
Xi, X2, X3, thus 

0 X x] = f ] [149] 


Hence, according to discussion earlier in this chapter, the quadratic 
form in terms of the new variables has the matrix 


(2 = 0 X (2 X Ot 

where (2 is the matrix of the given form. 

In the numerical example considered here, one has 

,‘l 0 0“ 

(2 = 0 X ' 


X Ot 


and with Eq. 148 this yields 


Cf 


'2.5 

0.2885 

0.707 


0.2885 

1.5 

-0.408 


0.707" 

-0.408 

2.0 


[150] 


[151] 


[152] 


Deleting the third row and column, one has the matrix of the desired 
abridged quadratic form, which reads 

P == 2.5x1^ + 0,577x1X2 + 1.5x2^ [153] 


In a more general case in which the given quadratic form F involves 
any number of dimensions (say n) and f < n linear independent con¬ 
straints are specified by the equations 

prl^l + pr2^2 -f- • • • + pm^n = 0 

Pr-j-l,lXi + pr-i-1,2^2 + • • • + ,n^n = 0 fl CAT 


Pnl^l •+ Pn2^2 ”!"*•• + pnn^n = 0 

in which r = w — / + 1, one has given I vectors pr, ^ • pn with 

components defined respectively by the coefficients in these equations 
taken by rows. The / planes orthogonal to these vectors are the constraint 
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planes, and the desired abridged quadratic form should have its variables 
confined to lie in the intersection common to these planes. 

Geometrically it is now convenient to think of the / independent vectors 
prj pr-^ij ’ • ^ pn SiS occupying a /-dimensional subspace immersed in the 
w-dimensional one. The common intersection of the constraint planes 
then occupies a (« — /)-dimensional subspace, and these two subspaces 
are mutually orthogonal to one another. One must find a new orthogonal 
set of co-ordinate axes such that the first (n — /) of these lie in the 
(ft — /)-dimensional subspace, while the remaining / of them lie in the 
/-dimensional subspace occupied by the vectors p^ pr-^i, ’ • ' pn- In this 
new co-ordinate system the constraint equations 154 become simply 
Xr = Xr+i = * • • = Xn = 0, and the variables xi, X2, • • • Xn^t must lie in 
the common intersection of the constraint planes because these lie in the 
(n — /)-dimensional subspace. 

The first step in the process of finding an appropriate set of new co¬ 
ordinate axes is to determine a mutually orthogonal set of / vectors^ that 
occupy the same subspace as the constraint vectors pr, pr-^iy ‘ ‘ • pn- It the 
latter happen to be mutually orthogonal, this first step is already done 
(as may be said of the single constraint case discussed above), but in 
general the constraint vectors are any independent set, not necessarily an 
orthogonal one. 

A mutually orthogonal set of vectors occupying the /-dimensional 
subspace is any set of / mutually orthogonal vectors each of which is 
expressible as a linear combination of the given constraint vectors. Such 
a set may be formed in an infinite variety of ways. One may begin, for 
example, by choosing pr as the first of the desired set. Then one may 
determine a second vector, orthogonal to pr, and expressed as a linear 
combination of pr and pr-{-\- Next one determines a third vector through 
demanding that it be orthogonal to the first two already found, and 
expressed as a linear combination of pr, pr+i^ Pr-^2y and so forth. 

Specifically this process may be indicated as follows, letting the desired 
mutually orthogonal vector set be denoted by pr, pr+i, • • * pn- To begin 
with, one chooses pr = pr- Next 


Pr+l — CLpr + ^pr-\-l 


pr • pr^l = apr * pr + Ppr * pr+l = 0 


[155] 


in which a and are nonzero. Here may be chosen arbitrarily. Thus 
letting /S = — 1 gives 

pr ■ Pr+l 
Pr-Pr 


a 


[156] 
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and thus pr+i is found. Then one writes 

Pr+2 = pT + PrJfX + y'pr+2 

Pr • Pr+2 = 0 [157] 

pr+1 • pr+2 = 0 

in which y' may be chosen at will and the last two equations solved for 
a' and s', thus determining pr+ 2 - 

In the next step one will have to solve three equations simultaneously 
for three unknown coefficients, etc. If the number of constraints is large, 
the computations may become tedious, but they remain straightforward. 
There are, of course, other ways in which the desired set of t mutually 
orthogonal vectors pr-- pn may be found, the method given here being 
rather simple in principle and no more tedious computationally than any 
other. 

One must now associate with these t vectors, n — t additional ones so 
as to obtain a complete set of n mutually orthogonal vectors pi - • • pn- 
This second step is carried out as in the single constraint case. The 
directions of these n vectors are those of the desired co-ordinate axes. 
The orthogonal transformation from the original co-ordinates to these 
new co-ordinate axes has a matrix 0 whose vector set is pi/\pi\, P2/IP2I, 

• • • pn/\pn\', that is, a set of unit vectors coincident with pi ■ • - pn- 
Equation 149 expresses the co-ordinate transformation, and Eq. 150 
gives the matrix of the quadratic form F in the new variables Xk in terms 
of the matrix of F for the original variables Xk- In terms of the new 
variables 

F = ^ X a X S] [158] 

and the arbitrary linear constraints, expressed in terms of the original va¬ 
riables by Eqs. 154, are simply Xr = x^+i = • • • = x„ = 0. The desired 
abridged quadratic form is. that part of F remaining after terms involving 
the last t variables are discarded. 

Perhaps it might be well to restate what has been done above in another 
way. Specification of the linear constraints 154 is equivalent to demanding 
that the vector x with components Xj • • • Xn is no longer free to assume 
any orientation in space, but is required always to be simultaneously 
orthogonal to t arbitrary and independent vectors pr---pn- Now these t 
vectors occupy only t of the n available dimensions of the given space. 
Hence, so long as the vector x moves about so as to stay outside the /- 
dimensional subspace occupied by the constraint vectors, it will fulfill 
the stated orthogonality restriction. For example, for n = 3 and / = 1, 
the vector x is free to move in a plane normal to the single specified con- 
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straint vector; for « = 3 and t = 2, the vector * is restricted to the one 
remaining dimension, defined as that direction in space which is orthog¬ 
onal to the plane (^-dimensional subspace) determined by (or occupied by) 
the two constraint vectors. 

When n is larger than 3, one must be mentally sufficiently adaptive in 
one’s thought to comprehend the analogous geometry implied by con¬ 
tinuing the identical algebraic reasoning beyond w = 3. For example, with 
M = 4 and t = 2, one must visualize a two-dimensional plane determined 
by the two constraint vectors as defining a corresponding two-dimensional 
subspace, and recognize that there are two other dimensions left over 
which define another subspace (the n — t dimensional one in this case) 
orthogonal to the plane determined by the constraint vectors in the same 
sense that if the vector x remains in this second two-dimensional subspace, 
it remains simultaneously orthogonal to the stated constraint vectors. 

Stated in terms of constraint planes, which are normal to their respec¬ 
tive constraint vectors, one must recognize that the (« — <)-dimensional 
subspace to which the vector x is restricted should be interpreted as a 
resultant common intersection of these planes. Again for « = 3 and 
t — 2, the two constraint planes intersect in a line, so that only one 
dimension is left for the vector x to exist in. However, for » = 4 and 
t - 2, the “ intersection ” of the two constraint planes becomes a two- 
dimensional subspace. In general, one must visualize the possibility of t 
planes in an w-dimensional space as possessing a common intersection 
which is (n — i)-dimensional, the latter defining a subspace orthogonal 
to the one occupied by the constraint vectors. 

What one is asked to do in the abridgment process is to find n mutually 
orthogonal unit vectors in the «-dimensional space such that t of these are 
linear combinations of the constraint vectors. These i vectors then clearly 
occupy the same subspace as the constraint vectors. Since the remaining 
(» — t) vectors are simultaneously orthogonal to the first t, they must 
be simultaneously orthogonal to the constraint vectors, and hence they 
define the (» — /)-dimensional subspacc in which the vector x can move 
and still conform with the restriction that it be orthogonal to all the 
constraint vectors. 

If one chooses new co-ordinate axes coincident in direction with this 
set of mutually orthogonal unit vectors, the matrix of the linear trans¬ 
formation, expressing the co-ordinates with respect to the new axes in 
terms of those relating to the original axes according to Eq. 149, is clearly 
that orthogonal matrix having these unit vectors as its vector set. In 
terms of the new co-ordinates the original constraints are equivalent to 
setting equal to zero those variables that refer to the axes lying within 
the subspace occupied by the constraint vectors, because these simplified 
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constraint equations dearly demand no more nor no less than the original 
ones. 

While there exists an infinite number of possible sets of new co-ordinate 
axes fulfilling the conditions just stated, note that the two subspaces 
defined by such axes are unique. For example, with « = 3 and t — 1, any 
co-ordinate system of which two axes lie in the plane determined by the 
constraint vectors (the ^-dimensional subspace) is acceptable. This plane, 
however, is fixed, and so is the remaining direction normal to it (the 
n — i dimensional subspace) no matter which one of the infinite possible 
choices one makes in determining a specific set of new axes. 

In summary one may say that the discussions of this article show how 
one can convert an arbitrary set of / linear constraints, such as those 
expressed by the Eqs. 154, into an equivalent set having the simple form 
of demanding that t of the variables be zero. The latter will, of course, 
not be the original variables but new ones related to the original ones by 
an orthogonal transformation. In the next article the object is to in¬ 
vestigate the effect of applied constraints upon the latent roots of a quad¬ 
ratic form. Since these latent roots are unchanged if the variables in the 
quadratic form are subjected to an orthogonal transformation, the form F 
has the same latent roots when it is expressed in terms of the new variables 
as it does when it is expressed in terms of the original variables 
*1 • • • Xn- One may therefore say that the effect upon the latent roots of 
F caused by imposing an arbitrary set of I linear constraints may be 
studied without loss in generality by considering only the simple case in 
which the constraints have the form expressed by setting / of the variables 
equal to zero. 

15. The effect of constraints upon the latent roots of a 

QUADRATIC FORM 

In this discussion only the absolute values of the latent roots are of 
interest. When the quadratic form is positive definite, these roots are all 
positive real numbers, and there is no need to emphasize specifically the 
fact that only their absolute values are to be considered. It is only in the 
more general case in which the latent roots may have negative as well as 
positive real values that such a distinction is necessary. However, since 
the discussion in Art. 10 regarding the iterated forms shows that the 
iterated form of even order can have only positive latent roots (which are 
those of the original form raised to an even power), it is clear that, 
although the present discussion be restricted to the consideration of 
positive definite forms, the conclusions reached apply equally well to the 
magnitudes of the latent roots in the general case. 
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In Art. 5 it is shown that the latent roots Xi, Xa, • • • Xn of the form 


F = £ OikXiXk [159] 

»^-i 

may be regarded as the extrema of F subject to the restriction of the **’3 
expressed by 

! [160] 

A;«l 

The correctness of this result may be made evident through considering 
the form F reduced to the normal form 

F = XjSi^ + Xa^a^ + • • • + XnX»* [161] 

by means of the orthogonal transformation 

x] = £2] [162] 

involving the modal matrix £. Because of the orthogonality of the latter 
transformation, the condition 160 is unchanged in form, that is, 

i = 1 [163] 

fc-i 

In terms of F as given by Eq. 161, and the condition expressed by Eq. 
163, it is clear by inspection that the latent roots are extrema of F. More 
specifically, if the roots are numbered in such a way that 

Xi > Xa > X 3 > • • • > X„ [164] 

one may see that the largest value of F for the condition 163 occurs for 
fi = 1, fa = X3 = • • • = x„ = 0, and equals Xi. The next largest sta¬ 
tionary value of F under the same condition occurs for xa = 1, fi = $3 = 

• • • = 2„ = 0, and equals Xa; and so forth. 

If the variables xj • ■ • Xn in E are subjected to an arbitrary set of t 
independent linear constraints, the resulting abridged form F in n — t 
variables has n — t latent roots which may be numbered so as to conform 
to the sequence 

Xi > Xa > X 3 > • • • > [165] 

It is the object of the following discussion to establish relations between 
the magnitudes of the latent roots of F and those of F. 

The constraint equations, which are assumed to have the form 

Xi = Xa = X3 = • • • = xt = 0 [ 166 ] 

are alternately expressed in terms of the variables 2* (related to the x* 
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through the orthogonal transformation 162) as 

£ IfkXk = 0 (r = 1, 2, • • • /) [167] 

A? 1 

in which the f,* are elements of £. 

Although jF, subject to the linear constraints, has latent roots that are 
different from Xi • • • Xn, nevertheless the expression 161 for F may be 
used to compute values of F corresponding to any values of the variables 
• Xn, and hence yields values for the abridged quadratic form pro¬ 
vided only that the assumed values for • • • Xn conform to the constraint 
equations 167. If in these equations one chooses to let x^+2 == ^<+3 = 

• • • = Xn = 0, there results a set of t equations in / + 1 unknowns, which 
surely possess a nontrivial solution for xi • • • xt^\ in agreement with the 
condition 163. For such a set of Xit-values, Eq. 161 yields 

F = Xi^i^ + X2X2^ H-h \t^iXt+i^ ^ (xi^ -j-... xt^i^) = X^+i [168] 

as may be appreciated by noting the inequalities in 164 and the condition 
163. 

Since F, subject to the linear constraints 166 or 167, is the abridged 
form Fj the result 168 shows that a possible value of the abridged form is 
at least as large as the latent root Xt+i of the corresponding unabridged 
form. If the maximum-minimum problem discussed in Art. 5 is applied 
to the abridged form F, one observes that the maximum value of F, 
subject to a condition in terms of its variables similar to 160 or 163, is 
Xi. The next largest stationary value is X2, and so forth. Inasmuch as it 
has been shown that a possible value for F is at least as large as X^^i, it is 
clear that the largest value Xi is surely as large as this, that is, 

Xi ^ \t+i [169] 

Suppose now that v additional constraints are imposed upon F, making 
t V constraints in all. The resulting abridged form, which may be 
denoted by F, can also be regarded as resulting from imposing the set of 
V constraints upon F. If the latent roots of F are denoted and numbered 
according to the sequence 

Xj > X 2 > X 3 > • • • > Xn—(— 1 > [170] 

then one may write two additional relations similar to 169 which read 

Xi ^ X<.(^i [171] 

and 

Xi ^ [172] 

In any one of the relations 169, 171, or 172 the equals sign holds only 
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if the constraints are chosen in a particular way. Thus for a particular 
form of the v constraints, the equals sign in 172 may be assumed to hold, 
but it will not simultaneously hold in 171 also as long as the original t 
constraints are considered to be arbitrary. Thus the relations 171 and 172 
are seen to yield 

X«>+i = ^<+»+i [173] 

which establishes relations between all the latent roots of F and a like 
number of those of F, since the integer v can have any value from 0 to 
n — i — 

Considering again the interpretation of the latent roots Xi • • • %n-t of 
F in the manner that those of F are interpreted in Art. 5, bearing in mind 
that F is the result of imposing certain constraints upon F, and hence that 
all the extrema of F are smaller than the respective ones of F, which are 
attainable only if its variables are free to assume particular sets of values, 
one recognizes the following additional relation as being true; 

X, ^ X, (j = 1, 2, • • • » - /) [174] 

Together with 173, one may summarize the results so far in the form 

X, ^ X, ^ X.+, [175] 

in which the index s may be given the integer values 1, 2, • ■ • n — A 
useful relation between the n — t latent roots of F in terms of the n 
latent roots of F is thus established. 

A case of particular interest is that in which a single constraint is im¬ 
posed upon F. The latent roots of F and F are then related as expressed by 

Xi ^ Xi ^ Xa ^ X2 ^ Xg ^ ^ X„_i ^ X„ [176] 

These inequalities are sometimes referred to as expressing the separation 
property of the roots of F and F. 

An interesting geometrical view of this last result is had through 
visualizing the ellipsoid associated with F, and the constraint plane as 
slicing the ellipsoid centrally at an arbitrary angle. The intersection of the 
ellipsoid with the plane yields an ellipse with principal axes whose lengths 
are clearly intermediate as compared with those of the ellipsoid. 

With reference to the pair of forms Fi and F 2 , discussed in Arts. 11 and 
12, it may be pointed out that the results of the present article apply also 
to the roots and those of an abridged pair of forms resulting from 
subjecting their common variables Xi ■ • • Xn to an arbitrary set of 
independent linear constraints. 
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PROBLEMS 

1. Write down the matrices of the following quadratic forms and determine whether 
or not they are singular. 

jPi =* 5 Xi^ - SXiX2 + SxiXz -f 4 jCiJC 4 + 2X2^ + 4 iC 2 X 3 -- 2X2Xi -f 5 X 3 ^ + 2x3X4 4- 6x4^ 
F2 = 8x1^ 4" 3 xiX 2 4 ” 7 xiX 3 4 " 9 x 2 Xi 4 * 9 x 2 ^ — 3x2X3 •— 3x3X1 4 ” 6x3X2 4 “ xs^ 

2. Show that the matrix of a quadratic form can be written as 



3. Transform congruently the matrices 



respectively with 



4. For what type of transformation matrix is the coUineatory transformation 
identical with a congruent one? Out of the following matrices, pick by inspection 
those that have this property: 



Check your selection by carrying out the transformation upon the matrix 



5. Compute the latent roots and proper values of the following quadratic forms: 

Pi = 4 “ 52 xiX 2 — 40x1X3 4 " 122 x 2 ^ 4 “ 20x2X3 4 * 66x3^] 

F2 = '^^[21x1^ 4- 24 xiX 2 4 - 120x1X3 4 “ 39 x 2 * — 60x2X3 + 30 x 8 *] 

F 3 = j3[49xi* 4xiX 2 ~ 80x1X3 4 - 46x2* 4- 40x2X3 4- 40x3*] 

F4 = Xi^ 4 " 2 \^XiX 2 — X2* 

6. Find the lengths of the principal semiaxes of the ellipsoid represented by the 
quadratic form: 

F = 177xi* 4“ 228 x 1 X 2 ~ 120 x 1 x 3 4 - 348x2* 4“ 60 x 3 x 3 4- lOSxs^ = 45 
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7. Compute the modal matrix of the quadratic form given in Prob. 6 and make an 
isometric plot showing the positions of the principal axes. 

8. Show that the quadratic surface 

2xi^ 4- -f Sxz^ - 2 

represents an ellipsoid of revolution. Compute the lengths of the semiaxes and find 
their direction cosines with reference to the given co-ordinate system. Write down the 
modal matrix. Is it unique? 

9. Reduce the following quadratic forms to sums of squares through orthogonal 
transformation and give the respective transformation matrices: 

Fi = 3.5xi* — 2x\X2 -f xixz + 1.6x2^ + 0.4x2X3 + 1.9x3^ 

F 2 = — 284xiX2 — 188 x 1 X 3 + 181x2^ — 256x2X8^— Sxs^ 

Fz = —2.6x1^ 2.4 xiX 2 "h 0.6x2 

F4 = 0.4 (xi^ 4- \/3 xiX 2 + 2x2*) 

10. Reduce the following quadratic form to its normal form: 

F = 0.487x1* — 0.784x1X2 4- 0.632xixs 4- 0.445xiX4 4* 0.487x2* 4“ 0.632x2X8 

4- 0.445x2X4 + 1.892x8* + 0.111x4* 


What is its rank? 

11. Find the orthogonal matrix which transforms 

F ~ 0.392xi* — 0.948x1X2 — 0.632x1X8 4- 0.444xiX4 4- 0.392x2* — 0.632x2X8 

— 0 . 444 x 2 X 4 4- 1.892x3* 4- 0.111x4* 

to the normal form. Find the latent roots and the signature. 

12. By forming the Gramian determinant, establish the linear dependence or 
independence of the vector set defined by the row matrices: 

[1 3 4 5 1 3] [2 3 4 5 6 7] [1 6 8 10 -3 2] 

Repeat for the set 

[1 -1 4 8 2] [3 -3 -2 -10] [4 2 5 8 -8] 

13. By means of elementary transformations find a matrix S which will reduce to a 
sum of squares the quadratic form 

F == 4xi* 4- 5 xiX 2 — fxiXa 4- 7x2* + fx2X8 -f 2x8* 

through a congruent transformation of its matrix G. Determine the corresponding 
diagonal matrix 2)i and the signature. 

Through a similar procedure find another matrix which also yields a reduction to 
a sum of squares. Express the relation between the two diagonal forms £D and 2)' of 
the reduced matrices by computing the diagonal matrix A in the equation 
3)' = Ai3)A. Show that it is always possible to find such a real A relating the alternate 
diagonal forms of a symmetric matrix. 

14. Using the following vector set, 

[1 1 -1] [-3 3 5] [-5 0 5] 
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form a matrix Q whose elements are computed as are those in the Gramian determi¬ 
nant. Find the latent roots of G and check the positive character of the principal 
minors of its determinant. 

15. If possible, reduce each of the foUowing quadratic forms to its canonic form 
and give the corresponding modal matrix as well as the transformation required to 
pass from the normal to the canonic forms. 

Fi = [83a£:i^ -f- 52xiX2 — 40jcijic3 + 122x2^ 20x2X3 4* 65jif3^]45“^ 

F2 = [49a:i^ — 4xiX2 — 80jciiC3 -f- 46x2^ + 40:r2:c3 + 40x3^]45'"^ 

16. Determine whether or not the following quadratic form is positive definite: 

F = 3xi^ — 4xiX2 — 4 x 1 X 3 -h 5x2^ -f 2 x 2 X 3 + 4:^3^ 

17. Find the triangular matrix 9^ that generates the matrix Q of the quadratic 
form 

F=xi^— 6 x 1 X 2 — 2 x 1 X 3 -t4xiX4 4 - 13x;2^4-10»2i»^8— 20x2Xa 4- 1 1 x 3 ^ — 14 x 3 X 4 , +25x4,^ 

and check the relation Q = 

18. (a) Find the extrema of the quadratic form 

F = -f[—7 jci^ — 10'\/3xiX2 4- 3x2^] 


when the variables xi, X 2 are subjected to the condition that the point P{xiyX 2 ) shall 
lie on the unit circle. 

(b) Find the extrema of 

F = ^[4:ri2 4- 4xiX2 4 4xiX3 + 149x2^ ~ 278 x 2 x 3 -f 149x3^ 


subject to the condition that P(xi,X 2 ,X 3 ) shall lie on a sphere of radius 2. Determine 
the signature of this quadratic form. 

19. Let a be the matrix of a positive definite quadratic form, A its discriminant, 
and a triangular matrix which generates G accordii^ to the relation G = 

Show that a possible procedure for the formation of is given by the relations: 
pkj == 0 for ^ > j\ pkj 5 ^ 0 for ^ ^ j. 


Pii = 


dij 

VWi 


p2i = 


=fc 


Bli 

y/Or\\Bl2 


p 3 i =:±: 


Ci2j 


\^Bi2Ci 


phi 


Ki,..^k^ 


- 1)7 


y/~j i—{k—i)Ki...h 


Pnn 


^ Va 


Here aij are the elements of the first row of G. The Bij are second-order minors 
formed from the first two rows of G by selecting the first and the yth columns. The 
C 12 , are formed from the first three rows of G by selecting columns 1 , 2 , and and so 
forth. 

20. By using the procedure given in the preceding problem compute a triangular 
matrix which generates the matrix of the quadratic form given in Prob. 17. 

21. Show through a proper expansion of the characteristic determinant of a 
matrix that its characteristic equation can be written in the form 
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(—X)’* + £ (principal diagonal elements) 

+ (—X)’*-^ 2^ (principal minors of order 2) 

+ (—X)**~® 22 (principal minors of order 3) 

—X]^ (principal minors of order n — 1) 

+ determinant = 0 

In view of this result, show that the sum of the latent roots of a matrix equals the 
sum of its principal diagonal elements, and that the product of the latent roots equals 
the determinant. Show further that if the determinant is zero, at least one latent root 
is zero; if the matrix is of rank » — 2, at least two latent roots are zero; and so on. 

22. Using the result of the previous problem, show that the roots of the equation 
X** + H-+ a{K = 0 are the latent roots of the matrix 


r ^ 

1 

0 

0 ••• 

0 

0 “1 

0 

0 

1 

0 ••• 

0 

0 

0 

0 

0 

1 ••• 

0 

0 

0 

0 

0 

.. • 

0 

1 

_ —Uo 

-ai 

— U2 

... 

• • * 

Un—1_ 


23. Let a be an'tith order square matrix and Xi, X 2 , • * • X„ its latent roots. The 
mth power of (2 is denoted by ffi. 

(a) If the latent roots are real and distinct, and numbered so that |Xi| > IX2I > 
* • • > |Xn|, show that for a sufficiently large m: 

IXil"* 21 (principal diagonal elements of 
IX 1 X 2 I”* ^ 2) (principal minors of order 2) 

1 X 1 X 2 X 31 "* ^ 21 (principal minors of order 3) 


1X1X2- 

(b) If the latent roots are real but there are a repeated roots so that 
[Xij > 1X2] > • * • > jXy| > jXy^lj = (Xg-p 2 j = • * • = |Xj,^aj ^ jXjjr^a^ll > * • * > jXn| 


derive the relations 




2 (principal minors of orders) 
22 (principal minors of ordery— 1) 

(principal minors of order g 4-1) 
a 22 (principal minors of order g) 


y = l,2,* • •g;g4-o£4-l,g4-a-f2, - • - n 


(c) Suppose, in the sequence |Xil > IX 2 I > • • • > lX„|, that the first A - 1 roots 
are real but that the roots Xa and X^-f 1 are conjugate complex with the angle 4>h. In 
this case show that 




^ (principal minors of order h 
22 (principal minors of order A — 1) 


and 


2 IXaI*" cos fmf>h ^ 


2 ^ (principal minors of order h) 

22 (principal minors of order h — \) 
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24. If F is a positive definite quadratic form in n variables, show that its character¬ 
istic determinant, when expanded as a pol 3 momial in X, consists of « + 1 terms with 
alternate algebraic signs, and that the same polynomial with all terms alike in sign is 
associated with a negative definite form. 

n 

25. Consider the quadratic surface OikXiXk = 1 and the plane 

t.Jb-l 

2^ AkXh = 0 

A-l 

(a) Show that the intersection of the plane with the surface can be expressed as a 
quadratic surface of n — 1 dimensions in the form 

br,x'fx\ = 1 

r,« »1 

and compute the values of the coefficients bra. 

(b) As a numerical illustration find the equation of the ellipse given by the inter¬ 
section of the ellipsoid of revolution 

and the plane 

—2a;i -h 3x2 xs « 0 

Find the lengths of the semiaxes of this ellipse and compute their direction cosines. 

26. Given the quadratic surface 

n 

H OikXiXk = 1 

and the parametric equation of a straight line 

Xj =ajt j « l,2,---n 

in which or, and are constants and / is a variable parameter. 

(a) Demonstrate that the line cuts the surface at most in two points and that the 
corresponding parameter values must satisfy the equation 

( 21 -H 2 2^ OtjfcptiiSjk ) f = 1 — 2^ (^ikPiPk 

Discuss the conditions under which there are 2, 1, or no points of intersection. 

(b) Compute the co-ordinates x\ and x"* {Jk = 1, 2, • • • «) of the points of inter¬ 
section. 

(c) If the straight line passes through the origin, show that 


X * * —X * 


OLk 


-sTt” 


dUfiLHOLk 


and interpret this result according to whether the quadratic form is p>ositive definite or 
not. 

(d) Write down the corresponding expressions appropriate to a quadratic form 
representing a cone. 
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27. Carry through the simultaneous reduction to the normal form of both quadratic 
forms in the following pairs: 

(i) Fi = 2 xi^ H- 2 xiX 2 + X 2 ^ F 2 = 4- 2 xiX 2 - X 2 ^ 

(ii) Fi = 20 : 1 ^ + 2 x 1 X 2 + 2 x 1 X 3 + 3x2^ — 2:i:2:r3 + 2 xz^ 

F2 = Xi^ 4 3x2^ — 231:2^^3 + 23132* 

(iii) Fi = 2x1^ 4- 6 x 1 X 2 4* 53C2* F 2 = 2xi3C2 

28. Compute the matrices and JP (see Eq. 101), and the matrices 

and for each of the three reductions in Prob. 27. 

29. Let a\ix\^ 4 a 22 ^C 2 * == 1 be the equation of an ellipse when referred to a system 
of oblique axes making an angle 0. 

Show that the principal axes of the ellipse make angles ofi and 0^2 with the 3Ci-axis 
that are determined by the relation 

(m^ — 1) =t \/— 1)^ 4- 4w^cos^<^ 

tan0^1,2 = -'- 7:,," ' ' =r 

(w^ + 1) ± V 4“ 1)* — 4m2 sin^ <t> 

in which m = aii/a 22 ; and that these axes can have any desired orientations through 
the proper choice of the ratio m. Observe that the angle between the axes is 90®. 

Write down the expression for a family of ellipses for which one principal axis 
coincides with the 3t:2-axis. 

30. Consider the pair of quadratic forms: 

Fi = 3xi^ — 2V'2A;i3t;2 4- 2:^2* and F 2 = xi^ 4* 2 \/ 2 xiX 2 — 2x^ 


Regard the variables x\ and 3 C 2 as the contravariant co-ordinates of a p)oint P referred 
to a system of axes for which the fundamental metric tensor has the matrix 


8 



(a) Make a plot of the curves Fi = 1 and F 2 = I in this system of reference 
co-ordinates. 

(b) Find the transformation of variables which simultaneously reduces both 
quadratic forms to their normal forms. 

(c) Find the orientations of the new co-ordinate axes relative to the old ones. 

(d) Compute the transformed fundamental matrix 8, 

(e) Find the orientations of the principal axes of the resultant ellipse with respect 
to the new co-ordinate system. 

31. Consider the pair of quadratic forms 

Fi — x\^ — 2xiX2 4- 2031 X 3 -|- 2x2* — 2 x 2 x 3 + 3x3® 

F 2 == 3xi® — 2xiX 2 -f 2X1X3 ~ X2* — 2X2X3 4 Xz^ 


in which xi, X 2 , X 3 arc contravariant variables with respect to an oblique co-ordinate 
system consisting of a triad of axes whose mutual angles are aU 60®. 

Reduce both Fi and F 2 to their normal forms through a transformation to a new 
co-ordinate system and find the orientations of the new co-ordinate axes with respect 
to the old ones. 



Ck. IV] 


PROBLEMS 


181 


32. Find the equation of the intersecting curve between the quadratic surface 

S3xi^ + 52xiX2 — ^Oxixz + 122x2^ + 20x^s + 65xs^ = 45 
and the plane 

5xi + Ax2 — 3x2 * 0 

and compute the lengths of the semiaxes of this curve as well as their orientation with 
respect to the assumed rectangular Cartesian co-ordinates. 

33. For the ellipsoid given in Prob. 32 find equations of the three planes containing 
the principal axes taken in pairs. 

34. Find the maximum perpendicular distance from points on the ellipsoid of 
Prob. 32 to the plane 

—2^1 + ^2 4" 2^3 ~ 0 

35. Given 

F = -^[21x1^ + 24xiX2 4” 120^ijr3 4" 39x^ — 60 x 2 X 3 4" 30ir3^] 

Find the abridged quadratic form that results if the variables are subjected to the 
condition that they determine a point which is constrained to lie on a plane normal to a 
vector with the components 1, 2, —1, and compute the latent roots of this abridged 
form. 

36. Th^ rectangular Cartesian co-ordinates forming the reference system for the 
ellipse 

30 : 1 ^ 4- 2X2^ + X3^ - I 

are subjected to a transformation to a new set of axes defined by the orthogonal vector 
set 

"i 3Vt\ [v! 3 "iTl] [0 I 

Find the equation of this ellipse in terms of the new variables and make plots in the 
new co-ordinate planes of the intersections of the ellipse with these planes. 

37. The real quadratic form 

n 

jF = 22 «<**<** 

<,t=i 

is subjected to the set of t linear constraints 

Z PrkXk =0 r = 1, 2, • • • / 

and the condition 

2 Z = 1 

In terms of the function 

F ^ G - F 4- xf 1 ~ i: + 2 i: f: nrPrkXk 

\ / r=lk^l 

in which X and mi * • * Lagrangian multipliers, show that the conditions fcr ►n 
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extremum of F subject to the constraints lead to the equations 

n t 

2 aikXi - Xx* + 2 MrM “0 (* = 1. 2, • • •«) 

» »1 r »1 

£ PrkXk =0 (f « 1, 2, • • • /) 

Jfc«l 

2 = 1 

k^l 

Show that this system of equations is sufficient to determine the unknowns 
xi - • • Xny fii* • • iJLty \ and that the extremum of F is given by F = X in which the 
X-values are roots of the equation 


(an - X) 
021 

012 

(a22 — X) * • 

<*ln 

* fl2n 

Pn 

pn 

pn 
• • • pt2 


dnl 

«n2 

(^nn X) 

Pm 

■■■pin 


Pn 

^12 

• Pm 

0 

... 0 

=.0 

pn 

P 22 

• Pin 

0 

... 0 


pn 

Pi2 

Pin 

0 

... 0 



38. Show that the determinant given in Prob. 37 furnishes the same latent roots as 
those corresponding to the abridged quadratic form. Following a method similar to 
that given in Prob. 21, obtain expressions for the coefficients of the various powers of 
X in this characteristic equation. 

39. Illustrate the procedure outlined in Prob. 37 with the quadratic form and the 
single constraint given in Prob. 32 and compare the results with the solution to that 
problem. 
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Vector Analysis 

1. Preliminary remarks and definitions 

The quantities considered in this chapter are functions of the co¬ 
ordinates of ordinary (three-dimensional) space. In some cases, they also 
may be functions of other independent variables such as the time. 

A scalar is a function which, for each set of values of its independent 
variables, is completely characterized by a corresponding magnitude. 
If the function is defined for all points within a given region, it is there 
said to constitute a scalar field. Potential functions, such as the scalar 
potential in an electric field or the thermodynamic potential of an ideal 
gas, are common examples. The geographical altitude as a function of 
latitude and longitude is a two-dimensional example of a scalar field. 

A vector is a function which is characterized at each point in space by 
means of a magnitude and a direction. If the function is defined for all 
points within a given region, it is there said to constitute a vector field. 
The earth’s gravitational field of force or the velocity field of a fluid are 
familiar examples. The magnitude of a vector function is a scalar. The 
vector function may, therefore, be thought of as a scalar to which a 
direction is assigned at each point in space. 

More specifically, however, two kinds of vector functions are dis¬ 
tinguished according to their processes of derivation. Thus, for example, 
the gradient of a scalar potential function is a vector. A simple example is 
the gradient in a mountainous terrain. A vector of a physically different 
nature is that used to represent a mechanical torque. The torque is pro¬ 
duced by a force acting upon a lever arm, and the resulting vector (by 
convention) stands normal to the plane determined by the force and the 
arm; that is, it coincides with the axis of rotation. The direction of the 
torque vector, moreover, must be defined in accordance with a right- or a 
left-hand screw rule. 

These two types of vectors, such as a gradient and a torque, are dis¬ 
tinguished respectively by the adjectives polar and axial. This distinction 
is not merely a superficial one which may be disposed of by the simple 
process of propounding a pair of suitable adjectives. One reason for 
making such a distinction is brought to light when the variables of these 
vector functions are subjected to a co-ordinate transformation, such as 
changing from a right-hand to a left-hand system of rectangular axes 
(see Fig. 1). In this case, the algebraic sign of the axial vector function is 
reversed and that of the polar vector is not. If both types of vector func- 
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tions are involved in a given problem, this circumstance must be care¬ 
fully considered. 

An axial vector may be the result of a vector product formed from two 
given vectors. It must be observed, however, that this is the case only if 
both the given vectors are either axial or polar. The vector product 
formed from a polar and an axial vector is polar. 

Since a scalar may be the result of a scalar product of two vectors, it 
appears that this question regarding the distinction between two t)rpes 






left-hand cartesian axes 


Fig. 1. Two systems of cartesian axes. 


of vectors is not confined to vector functions. Thus a scalar function 
which results from the scalar product of a polar and an axial vector has 
different mathematical properties from those of a scalar function which 
is the scalar product of two polar or two axial vectors. The first of these 
functions reverses its algebraic sign when subjected to a transformation 
from a right- to a left-hand co-ordinate system; the second does not. The 
latter is invariant to any co-ordinate transformation, as a true scalar 
should be. An energy function is a scalar of this type. The other kind of 
scalar function, which is also encountered in physical problems, is called 
a pseudoscalar, since it has all the properties of a scalar except that it is 
not invariant to certain types of co-ordinate transformations. 

The product of a scalar and a vector yields a vector of the same type. 
Multiplication with a pseudoscalar, however, changes an axial vector 
into a polar one, and vice versa. It should also be observed that the addi¬ 
tion or subtraction of vectors or scalars should not be carried out without 
regard to their type or origin. 

In order that the geometrical visualization of it may be facilitated, a 
field is commonly pictured as associated with a system of so-called flow 
lines. In hydrodynamics, for example, these are the paths which are 
traversed by the component particles of the fluid. Since the velocity 
vector is tangent to these trajectories at every jxjint within the flow 
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region, certain physical characteristics of the vector field itself can be 
recognized from such a system of flow lines {Jlow inap)f^ 

The magnitude of the function representing the vector field at any 
point is given by the density of flow lines in the surface normal to the 
vector at that point. The nximber of lines chosen to represent unit density 
is, of course, arbitrary, but it is significant to observe that since the 
magnitude is a continuous function (except at certain points or surfaces 
where lines begin or end), all points within the field must be thought of 
as occupied by lines. 

A given bunch of these lines, moreover, cannot intertwine with each 
other, because their continuous distribution would then necessitate a 
crossing of lines at some points, and this is impossible since their direc¬ 
tions must everywhere be unique. The lines defining the longitudinal 
surface of a given bunch form what is known as a tube. Unless such a 
tube contains regions from which lines emanate or upon which they 
terminate, the total number of lines enclosed by it must evidently 
remain constant throughout the flow region defined by the tube. 

From this more physical point of view, vector fields are distinguished 
according to either of two characteristically different (yet in a sense 
complementary) properties which they may separately or simultaneously 
possess. Thus if the flow map exhibits lines which close upon themselves 
(are endless), the field is said to exhibit turbulent characteristics. If none 
of the flow lines close upon themselves, the field is said to be nonturbu- 
lent, t In connection with the latter statement it must be recognized, of 
course, that a flow map for a finite region may exhibit no closed paths, 
yet the greater field may be turbulent, for some of the paths may close 
outside the finite mapped region. 

A vector field which is solely turbulent (alternatively called rotational 
or solenoidalX) is associated with a flow map containing closed paths 
only. Figure 2 shows an example of such a field. A nonturbulent field 
(also called an irrotational or a potential field) is associated with a flow 
map in which all the lines begin at a source and end upon a sink (or nega¬ 
tive source). For this reason, the potential field is sometimes referred to 
as a source field, and the turbulent one as a source-free field. Figure 
3 illustrates an irrotational field. 

In the sense that a source is the cause or origin of any field, the turbu¬ 
lent field must, of course, also have its sources. These, however, are 

*These matters are discussed in greater detail in Electric Circuits^ pp. 23-71. 

tThe term lamellar is sometimes used to describe such a field. 

tA solenoid is a channel or tube. The term “ solenoidal ” does not appear to be particularly 
appropriate because tubes of flow lines can also be mapped in a potential field. The important 
characteristic of the rotational field is the fact that its tubes close upon themselves, each 
forming an endless conduit containing the same number of flow lines throughout the length 
of its circuit. 
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referred to as vortexes. They are the whirlpools or eddies in which the 
field has its seat or origin. A turbulent field is sometimes also called a 
vortex field. 

An arbitrary vector field can exhibit both turbulent and nonturbulent 
characteristics, caused by the simultaneous presence of sources and 
vortexes. The turbulent and nonturbulent components of this field are, 
however, linearly independent. In other words, an arbitrary vector field 



Fig. 2. A vector field which is solely turbulent. 


may always be represented as the linear superposition of two independent 
components, one of which is a purely turbulent and the other a purely 
potential* field. 

These matters, together with a number of useful vector operations and 
their interrelations as well as the geometrical interpretations of them, 
are discussed in the following articles. One of the various operations 
encountered here is the linear transformation discussed in Ch. III. The 
coefficients of this transformation (elements of its matrix) may be 
functions of the space co-ordinates, so that for each point in space, a 
particular vector transform is associated with any given vector. This 

*This rather common designation for a nonturbulent field is appropriate because a vector 
function representing the gradient of a scalar potential is inherently nonturbulent, as is shown 
in detail subsequently. 
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transformation function is called a tensor"^ of valence 2. The order of the 
tensor is that of its matrix. For ordinary space, therefore, the tensor is 
of the third order. The coefficients of the transformation are referred to 
as the components of the tensor. 

A tensor of higher valence is a function which, at every point in space, 
associates a tensor of the next lower valence with any given vector. A 



tensor of order n and valence v has n^ components. For example, a tensor 
of the third order (for ordinary space) and valence 3, has 3^ or 27 com¬ 
ponents. Its matrix may be regarded as a three-dimensional array. In 
this classification, a vector is sometimes referred to as a tensor of valence 
l,t and a scalar as a tensor of valence 0. 

*The name tensor originated when this kind of function was first used in connection with 
problems dealing with stresses in elastic media. 

tin this interpretation of a vector, its components are regarded as defining a row matrix, 
and the linear transformation (tensor) corresponding to this matrix is a single linear equation 
like one of the equations of the set 3, Ch. III. This transformation is seen to transform a given 
vector X into a scalar (single component), but the classification of a vector as a tensor of 
valence 1 nevertheless appears to be inaccurate because it confuses the vector with a trans¬ 
formation. It would be more proper to say that the components of a vector (not the vector 
itself) may be regarded as those of a tensor of valence 1. 
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Since the analysis of a physical problem usually requires a co-ordinate 
system of some kind, the various vector operations discussed in this 
chapter are expressed not only in vector form but also in terms of an 
assumed system of co-ordinates. In most of the detailed formulations, 
the rectangular Cartesian system, being the simplest, is chosen. Unless 
mention is made to the contrary, a right-hand system of axes is assumed. 
The latter is so named because a right-hand screw, turning in the direc¬ 
tion of the shortest route from the positive a:-axis to the positive y-axis, 
advances in the direction of the positive z-axis. Transformations of the 
important vector operations to some of the orthogonal curvilinear co¬ 
ordinate systems more frequently encountered in practical problems are 
given in a subsequent article. 

2. The scalar product 

The scalar product of two vectors A and B (also called the inner 
product) is defined as the product of their magnitud.es multiplied by the 
cosine of the angle between them. The scalar product is denoted by a 
dot placed between the symbols A and B ; hence 

^•5=mi5|cosfl [1] 

in which 6 is the angle included between the two vectors.* 

According to this definition, the scalar product may alternatively be 
regarded as the product of the length of either vector with the projection 
of the other upon it. If one of the vectors, for example, £, is given by the 
vector sum (according to the parallelogram law of addition) of two other 
vectors, as in the expression 

B^C + D [2] 

then 

A^B = A-{C + D)=AC + A-D [3] 

This result is seen to be true because the projection of B upon A is evi¬ 
dently equal to the sum of the projections of C and D upon A . Hence the 
distributive law holds for scalar products. 

When it is necessary to express the scalar product in terms of the 
components of the vectors A and B with reference to a rectangular 
Cartesian co-ordinate system, it is convenient to define a set of unit 
vectors having the directions of the or-, y-, and z-axes. These unit vectors 

* According to this notation, which is attributed to Gibbs, the scalar product is sometimes 
also referred to as the dot product. An alternative notation quite frequently found in the 
literature is to indicate the scalar product by enclosing the s 3 rmbols for the two vectors in 
parentheses, thus: A* B = {AB). 
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are denoted respectively by the letters i,j, and k. The components of the 
vectors — that is, their projections upon the x-, y-, and 2 -axes — are de¬ 
noted respectively by Ax, Ay, At, and Bx, By, Bf 
The vectors themselves may then be written 

A — iAx jAy -|- kAt [43 

and 

B — iBx jBy -h kBt 

The terms in these equations are vector components, and the right-hand 
sides represent vector sums. The scalar product of A and B may now be 
written 

A • B = (iAx "hjAy kAt) • (iBx jBy -|- kBt) [5] 

Since the distributive law holds, the right-hand side of Eq. 5 may 
be replaced by the sum of nine component scalar products such as 
(iAx) ■ (iBx), (iAx) • (jBy), etc. The unit vectors i, j, k are mutually at 
right angles to each other. Hence the scalar product of any one of these 
with any other one is zero, and the scalar product of any one with itself 
is unity; that is 

i'j — j • k = k ■ i = 0 

i.i=j.j = k-k = l 

Consequently, only three of the nine component scalar products resulting 
from Eq. 5 have nonzero values, so that 

A • B = AxBx -1- AyBy -|- AfBt [7] 

The scalar product is thus given by the sum of the products of the corre¬ 
sponding components of the two vectors. This result is true only for a 
rectangular co-ordinate system (discussed in Art. 4, Ch. Ill) and no 
longer holds when the co-ordinate axes make oblique angles with each 
other. 

It is clear from the definition of the scalar product that the commutative 
law holds; that is, 

A B^ B A [8] 

Since the scalar product of two vectors yields a scalar, a triple scalar 
product such as might be denoted by A • B • C has no meaning, and the 
question whether the associative law holds hence does not arise. 

3. The vector product 

The vector product of two vectors A and B (also called the outer 
product) is defined as a vector whose magnitude is given by the product 
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of the magnitudes of A and B, multiplied by the sine of the angle between 
them. The direction of the vector product is related to the directions of 
A and B by the right-hand screw rule in the sense that a right-hand screw, 
turning in the direction of the shortest route from the tip of A to the tip 
of B (assuming that these emanate from a common point*), advances in 
the direction of the vector product. 

In connection with this definition, it is significant to observe that the 
angle 9 between A and jB, which enters into the determination of the 
magnitude of the.vector product, is that angle through which the right- 
hand screw defining the direction of the resulting vector is turned in 
passing from the tip of A to the tip of B. This is usually taken to be the 
smaller of the two supplemental angles through which it is possible to 
turn in passing from one to the other of any two coterminous vectors A 
and B. The result, however, is the same if the larger of these two angles 
is chosen, because the direction is then reversed and the algebraic sign of 
the magnitude is reversed also. 

In the Gibbs notation, the vector product is denoted by a cross, placed 
between the symbols for the two vectors, f Thus the magnitude of the 
vector product is expressed by 

1^ X 5] = m |3l sin [9] 

This expression is recognized geometrically as being numerically equal to 
the area of the parallelogram defined by the two coterminous vectors A 
and B. 

If the cosines of the angles between the normal to the surface of this 
parallelogram (in the direction of the vector A ^B) and the x-, y-, and 
s-axes of a rectangular co-ordinate system are denoted respectively by 
cos («,x), cos (»,y), and cos (»,z), then 

F* = |j 4 X 5| cos (»,x) 

Vy—\A^ B\ cos (»,y) [10] 

F, = |4 X B\ cos (n,2) 

represent the projections of the area of the parallelogram upon the yz, 
zx, and xy planes respectively. Since 

cos* («,x) -f cos* (n,y) -|- cos* {n,z) = 1 [11] 

•In other words, the vectors are for the moment assumed to be coterminous, as they 
usually are. The definition of the vector product (and the scalar product also) is, however, 
independent of whether the vectors are coterminous. If they are not, then the direction of 
the vector product may perhaps be more easily visualized by first displacing one of the vectors 
parallel to itself until the two become coterminous. 

fFor this reason, the vector product is sometimes also referred to as the cross-product. 
An alternative method for indicating the vector product is to enclose the symbols for the two 
given vectors in square brackets, thus; A^B ^ [AB'\. 
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it follows that 

\A^B\= + V + [12] 

and hence F*, Vy, and F, are seen to be the components of the vector 
product 

V^A^B [13] 

In other words, the component areas given by Eqs. 10 are recognized 
as having the properties of vector components, and their vector resultant 
is identified with the vector product as defined above. 

Observe in this connection that a component area (projection of the 
surface of the parallelogram deter m ined by the vectors A and B upon one 
of the three co-ordinate planes), as defined by one of the three Eqs. 10, 
is not merely a geometrical projection, but in addition involves an alge¬ 
braic sign which reverses if the direction of the normal is reversed (re¬ 
placing the angles of the cosine functions by their supplements). That is, 
the algebraic signs of the components 10 are controlled by the right-hand 
screw rule for the vector product. 

If the projections of the vectors A and B upon the yz, zx, and xy planes 
are denoted by A^^‘\ B^^*\ and so forth, it follows from these considera¬ 
tions that the vector components of F are given by 

fFx = A'^^^ 

jVy = X [14] 

The magnitude of one of these components, such as F„ for example, is 
given by 

F* = sinfl^* [15] 

in which is the angle included between ^4**'*^ and Replacing this 
angle by the difference between the angles which these vectors separately 
make with the y-axis, applying the trigonometric identity for the sine of 
the difference between two angles, and noting that the components of 
and are those of A and B on the Y and Z axes, it is found that 

F* = AyB^ - A^By [16] 

and similarly that 

Vy = A,B,-A.B, [17] 

and 

F. = A^By - AyB^ [18] 

These are the components of the vector product expressed in terms of 
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those of the two given vectors A and B. If the vector B is the resultant 
of two other vectors, that is, if 

B = C + D [19] 

the decomposition of C and D into their rectangular components, and 
substitution into Eqs. 16, 17, and 18 show that 

V = A>‘B=^Ay(C + D)=A-C + A^D [ 20 ] 

Hence it follows that the distributive law holds with regard to the vector 
product. 

Conversely, if the distributive law is assumed to hold, the vector 
product 

^ X 5 = (iAx +jAy + kAi) X {iBx +jBy + kB^) [21] 

may be replaced by the sum of nine component vector products. Ac¬ 
cording to the definition of the vector product, 

ixi=jyj = k^k = 0 [ 22 ] 

and 

ixj = k = —j*i 

jxk = i=-k^j [23] 

kxi j 

SO that three of the nine terms represented by Eq. 21 become zero, and 
the remaining six yield 

A ^ B=^i{AyBz-^AzBy)'\-j{AzBx'^AxBz)'^k{AxBy—AyBx) [24] 

This result is. seen to agree with that stated by Eqs. 16, 17, and 18. 

It is useful to recognize that the vector product may be written in the 
following determinant form; 

i j k 

A ^ B Ax Ay Az [25] 

Bx By Bz 

The Laplace expansion of this determinant in terms of the elements of 
its first row yields the vector product in the form given by Eq. 24. 

Although the distributive law holds for the vector product, the com¬ 
mutative law evidently does not, since 

A ^ B ^ —B^A [26] 

The triple vector product 

A ^ B^C [27] 

has a unique meaning only when the order in which the products are to 
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be carried out is indicated. Thus in the association indicated by 

A*{B^C\ [28] 

the product B x C is formed first, and then the vector product of A with 
this vector is determined. The result is normal to B x C and hence is a 
vector which lies in the plane determined by the vectors B and C. In the 
association indicated by 

X 5] X c [29] 

the product [A x 5 ] is formed first, and then the product of this vector 
with the vector C is determined. The result in this case must be normal 
to A B, and hence is a vector which lies in the plane determined by 
the vectors A and B. 

Evidently 

ri X [5 X C] [^ X 5] X C [30] 

so that the associative law does not hold for multiple vector products. 

Since the resultant vector for the triple product 28 lies in the plane of 
the vectors B and C, it must be possible to express this vector as a linear 
combination of B and C, that is, 

X [;B X C] = /SB + tC [31] 

An evaluation according to the form given by Eq. 24 for the vector 
product shows that 

ri X [B X C] = (x4 . C)B - (x4 • B)C [32] 

which agrees with Eq. 31, in which 

jS = {A • C) and 7 = — (ri • B) [33] 

The triple product 29, on the other hand, is 

[ri xB] xC = -Cx[ri xB] = Cx[Bxri] [34] 

This has the form of the triple product in Eq. 32 with A and C inter¬ 
changed. Hence 

[x4 X B] X C = (A • C)B - (B • C)A [35] 

which is a vector lying in the plane determined by the vectors A and B, 

as stated above. 

4. The scalar triple product 

The following combination of a vector and a scalar product 

x4-[BxC] [36] 

in which A , B, and C are arbitrary vectors, is called a scalar triple product. 



194 


VECTOR ANALYSIS 


[a. V 


The definition of the scalar product in the form given by Eq. 7, together 
with the determinant form 25 for the vector product, shows that the 
scalar triple product may be expressed as the value of the determinant 


A [B-C] 


Ax Ay Az 
Bx By B, 


[37] 


The result is, of course, a scalar. 

Since the transpose of a determinant has the .same value,* the rows in 
the determinant 37 may be written alternatively as columns. The value 
reverses its algebraic sign when any pair of rows are interchanged, but it 
remains unchanged if this interchanging is done twice in succession. Since 
the cyclic order of the letters A^ B,C can be changed to B, C, A by two 
interchanges, and to C, ^B by two more interchanges, it follows that 

A-[B^C] ^ B-[C-A] ^C^[A-B] [38] 



Aja projection of vector A upon B x C 
IBxCI«areaofparallelogram OBPC 
Fig. 4. A geometrical interpretation of a scalar triple product. 

A geometrical interpretation for the scalar triple product is readily 
given as shown in Fig. 4. The magnitude of [B ^ C] equals the area of the 
parallelogram determined by 5 and C;its direction is normal to the plane 
of this parallelogram. If the scalar product is interpreted as the length 
of the vector [B^C] multiplied by the projection of A upon it, the scalar 
triple product is seen to be equal to the product of the area of the 
parallelogram determined by B and C, multiplied by the component of A 
normal to this surface. The result evidently represents the volume of the 
parallelepiped of which three coterminous edges coincide in length and 

*See Art. 2, Ch. I. Specifically, this is there stated as the property VIII. 
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direction with the three vectors A, B, and C. The parallelogram deter¬ 
mined by B and C is regarded as the base of this parallelepiped, and the 
normal component of A is its altitude. In the equivalent forms given by 
Eq. 38, the base of the parallelepiped is alternatively regarded as defined 
by the vectors C and ^4, or .4 and B. These alternate interpretations are 
illustrated in Figs. 5 and 6. Each of the three expressions in Eq. 38 
represents the volume of the same parallelepiped. 



IC X Al * area of parallelogram OCQA 

Fig. 5. Alternate interpretation of 
a scalar triple product. 



=projection of vector C upon A x JB 

lAxBUarea of parallelogram OBSA 

Fig. 6. Alternate interpretation 
of a scalar triple product. 


In connection with this scalar triple product, observe that the brackets 
enclosing the vector product of B and C in the expression 36 are signifi¬ 
cant because they indicate the order in which the operations are to be 
carried out. Thus, if this triple product were written yl • 15 » C, it might 
be thought that A • B could be carried out first if desired. This procedure, 
however, yields a scalar, and the subsequent vector product with C then 
has no meaning. 

5. XlIE GRADIENT 

A single-valued scalar function of the space co-ordinates x, y, z is 
denoted by the symbol U. It is a function of position or location only. 
The points in space at wliich U has a given value, for example, C, define a 
surface which is referred to as a constant-value surface. Any number of 
such surfaces, for various assumetl values of the constant C, may be 
mapped. In particular, it is expedient to map a series of constant-value 
surfaces for values of C which differ by integer multiples of some chosen 
interval. A familiar example of such a map is that for the two-dimensional 
altitude function in a geographical terrain. Here the function U is constant 
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along lines instead of surfaces. These are called contour lines, and the 
resulting plot is spoken of as a contour map. 

Such a map places the variation of the function U in evidence, since 
the function evidently changes slowly in those regions where the lines or 
surfaces are far apart, and rapidly where they are closely spaced. The 
rate at which U varies in any given direction at a point in space is 
determined approximately by the ratio which the interval chosen for the 
constant C-v^ues has to the distance measured between two neighboring 
surfaces in the given direction at the point in question. If the interval in 
the C-values at this point is allowed to become smaller and smaller, the 
corresponding limiting value of the ratio accurately yields the desired 
rate of change of U. This value is called the directional derivative of U. 

It is apparent that the directional derivative of 17 is a maximum at a 
given point if the derivative is taken in a direction normal to the constant- 
value surface passing through that point, because the distance between 
neighboring surfaces is evidently smallest in the normal direction. This 
maximum value of the directional derivative is called the normal deriva¬ 
tive of U. 

As a function of the space co-ordinates, the normal derivative of U 
appears to have the properties of a vector function. The truth of this 
statement may be seen from the fact that if dn is the differential distance 
in the direction of the normal between two neighboring constant-value 
surfaces for which C differs by dC, and if ds is the distance between these 
surfaces in any other direction s, then, except for differentieds of higher 
order, 

dn — ds 00 & 9 [39] 

where 0 is the angle between the normal and the direction s. It follows that 


dU dU dn dU 

— = —r- = -— cos ® 
ds dn ds dn 


[40] 


in which dU/dn is the normal derivative of U. 

This result shows that if the normal derivative is regarded as a vector 
pointing in the direction of the normal, the derivative of 17 in any direction 
5 is given by the projection of this vector upon a line having that direction. 
The normal derivative, therefore, has tru'e vector character. This vector 
is called the gradient of U at the point at which the normal derivative is 
evaluated. 

The gradient is defined as pointing in that direction in which U in¬ 
creases and it is evidently a function of the space co-ordinates, since its 
magnitude and direction depend upon the point at which dU/dn is 
evaluated. For a geographical altitude function, the gradient at any 
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point indicates the direction of steepest ascent, and its magnitude equals 
the maximmn rate of change of altitude with distance at that point. 

In equations, the gradient is written in the abbreviated form: grad U. 
If « denotes distance measured along the normal at any point in the 
direction in which U increases, and »i represents a unit vector in this 
direction, the gradient is expressed by the vector equation 

grad U = nt~ [41] 


If Si denotes a unit vector in any direction s, the component of the 
gradient in that direction is given, with the help of the scalar product 
and Eq. 40, by 


grad, U = Si ‘ grad U = = 

on 


dU ^ dU 
— cos d = — [42] 

dn ds 


In a rectangular co-ordinate system, the components of the gradient are 


. „ dl/ , „ dU 

gradx U grad„ U = — 

A TT 

grad, U = 

oz 

[43] 

and hence 



grad U = # — + j — 
dx By 


[44] 


A more compact form for this expression is obtained by defining the 
so-called Hamiltonian operator* 


V = +j^ + 

dx dy dz 


The equivalent of Eq. 44 then reads 

grad U = 7U 


[45] 

[46] 


The operator V may in some respects be formally treated as a vector 
with the components d/dx, d/dy, d/dz. These, however, cannot in general 
be manipulated as though they were ordinary algebraic coefficients. 
They are differential parameters (or operators) of the first order, and 
hence perform the operation of differentiation upon whatever function 
follows them. 

For example, if W is another scalar function, the rule for differentiating 

•Since the symbol for this operator is an inverted Greek capital delta, it is frequently 
referred to by the name “ del,” and grad U is alternatively called “ del of U” Another name 
for the operator V is “ nabla,” after the Greek name for a harp, which this symbol re¬ 
sembles in form. 
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a product shows that 

V(UW) = UVW + WVU [47] 

or 

grad iJJW) = U grad PT + TF grad U [48] 

Another example is the scalar triple product 36 in which the operator V 
takes the place oi the vector A . Here the relation 38 is not applicable 
without due attention to the implied operation of dififerentiation in the 
multiplication of V with the functions B and C. The correct evaluation of 
the expression V • [^ x C] is given in a subsequent article (see Art, 16) 
after the operations V • A and V ^ A have been discussed. The present 
remarks are made merely to caution the reader against any careless ma¬ 
nipulation of the vector operator V, 

An important property of the gradient comes to light from a con¬ 
sideration of the so-called line integral of 
this vector function evaluated for an arbi¬ 
trary path extending between any two 
points in space. Thus if 

/ = grad U [49] 

then the integral 

jTV • ds [50] 

is referred to as the line integral of the 
vector function / between the points 
a{xi,yi,zi) and b{x2,y2,Z2)^ These two 
points are assumed to be connected by a con¬ 
tinuous path or curve S of arbitrary form. 
Distance along this curve is denoted by the 
symbol s. The differential vector distance 
ds is at any point tangential to the path in. the direction of continuous 
progress along it from a to 6, and in magnitude equals the scalar increment 
of length ds. The scalar product/* ds then equals the component of/ 
coincident with the direction of travel along the path at any intermediate 
point, multiplied by the corresponding path increment. This relationship 
is illustrated in Fig. 7. 

If / represents the force on some particle which is constrained to follow 
this path (like a bead on a bent wire), in the absence of friction the line 
integral 50 evidently yields the total work done by the force as the particle 
travels along the path from a to b. 



Fig. 7. A scalar product in¬ 
volving the differential vector 

ds. 
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According to Eqs. 40 and 41, it is recognized that 

/ • ds = • ds — = — ds = dU [51] 

dn ds 

in which dU is the dififerential increment of work done by the force / in 
moving the particle through the path increment ds.* Since Z7 is a function 
of position only, dU is a total differential. Hence 

f / • ds = f grad C/ • ds = f dU = U{x 2 ,y 2 ,Z 2 ) - U{xx,yi,zi) [52] 

«/a t/tt tia 

From this result it is concluded that the line integral of the gradient 
between any two points is independent of the path joining these points. 
Hence if the particle is subsequently returned to the point a along any 
other path from h to a, the total work done by the force / as the particle 
traverses the closed circuit from a to 6 and back to a, is zero. 

Symbolically, the line integral extending over a closed circuit is 
indicated by a circle placed upon the integral sign. Thus the vector func¬ 
tion defined as the gradient has the property that 


^ grad 


C/ • ds = 0 


It is important to observe that the truth of the results expressed by 
Eqs. 52 and 53 depends upon the single valuedness of the function U. 
This restriction on the function £/, which is stated in the opening para¬ 
graph of the present article, is not always met by functions dealt with in 
practical i)roblcms. Further considerations, necessary when U is multi¬ 
valued, are given in Art. 14 of this chapter. 

In the above argument, the force/ is regarded as due to some external 
agency which is causing the motion of the particle along a given path. 
This external or driving force must, of course, be balanced by an equal 
but oppositely directed force of reaction. The latter is due to the inherent 
properties of the medium of system through which the particle is moved. 
If F denotes this force of reaction, evidently 

F = —grad U [54] 

In this connection, U is spoken of as the potential function of the sys¬ 

tem, and F is the vector field of force associated with U. 11 Uq denotes 
the value of U at some chosen datum point, then U — Uq represents the 

,dU dU dU 

*One may alternatively verify this conclusion by writing J — i-z—V j -z — 

ox oy oz 

and ds = i dx j dy + k dz, whence, according to Eq. 7, 

dU dU dU , 

/ • ds — — dx — dy ~ dz == dU 
ox oy oz 
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work which must be done upon the particle to move it from the datum to 
the point to which U refers. This work is called the potential energy of the 
system consisting of the given particle and the medium in which it is 
embedded. 

A simple example is the potential energy of a particle (usually con¬ 
sidered to have unit mass) located at some altitude above sea level. 
The function F is then referred to as the earth’s gravitational field 
of force. Here the significance of the relation 53 is readily visualized. 
Thus, whatever work may be done by the external force / while the 
particle traverses part of the closed path is returned to the external agency 
during the traversal of the remainder of the circuit. This would be the 
case, for example, if one were to carry some object around a closed path 
on the side of a mountain. 

The work which the external agency may contribute during the 
traversal of a certain portion of the path is thought of as stored by the 
force field through which the particle is moved, and the significance of 
Eq. 53 is that such stored energy is not lost but may be completely 
regained. A force field which has this property of conserving whatever 
energy increment may be imparted to it is called a conservative field. This 
is the property of a vector field defined by the gradient function. 

Such a vector field is evidently irrotational in character, for if the flow 
map for this field wore assumed to contain any lines which close upon 
themselves, one of these could be chosen as the path for the integral in 
Eq. 53, and the value of this integral would then certainly not be zero. 
Hence the gradient always defines a purely potential field, all the lines of 
which must emanate from sources and terminate upon sinks. A conserva¬ 
tive field is always irrotational. 

Conversely, if for a given vector field F it is known that 

• ds = 0 [55] 

it must be possible to define a potential function U such that F is given by 
Eq. 54. 

6. The divergence 

The sources of a potential field are sometimes thought of as con¬ 
centrated at points or distributed along filaments or over surfaces. 
Whereas such source distributions may, in the discussion of certain 
physical problems, be convenient from an analytic point of view, they 
nevertheless are idealizations which require a proper mathematical 
interpretation. For the present discussion, the sources of a potential 
field are considered to be continuously distributed throughout space. 
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According to the hydrodynamic analogy, a region in which sources are 
located is one from which fluid emanates in a continuously distributed 
fashion, like oil seeping up through the pores of a bed of quicksand. (The 
pores as well as the rates of flow through them are to be thought of as 
being infinitesimal.) The object of the present discussion is to formulate 
some means for describing the fluid productivity of an infinitesimal 
element of space in a source-filled region. In other words, some measure 
of source density or intensity is needed in order that a given distribution 
of sources may be described and the relation of this distribution to the 
associated field intensity may be determined. 

The net rate at which fluid emanates from a small but finite productive 
region may be measured through integrating the rate of flow over a 
surface enclosing this region. If this net rate is divided by the enclosed 
volume, the resulting figure represents an average rate of productivity 
per unit volume for this region. The actual rate of productivity per unit 
volume may, of course, vary from point to point throughout the region. 
At any given point, it is expressible as the limit of the average rate 
obtained through shrinking the enclosure about that point until the 
contained volume becomes infinitesimal. 

This limiting value is a convenient measure of the intensity of the 
source region at any point, and it is referred to as the divergence of the 
flow field at that point. Although the flow field is a vector function, its 
divergence is clearly a scalar. 

If A is any vector function, then in accordance with ‘the discussion 
just given, its divergence (abbreviated div A) may be mathematically 
defined by 

^ A • da 

dWA = limit > • [56] 

. encloBed volume 

The circle on the integral sign in the numerator indicates that the inte¬ 
gration extends over a closed surface. In this integral, da is a vector surface 
increment. Its magnitude equals the scalar differential area da at any 
point on the surface, and its direction is that of the outwardly directed 
normal at that point. The scalar product A • da, therefore, represents the 
product of the normal component of A and the scalar differential area da 
at the same point. This equals the rate at which fluid passes through the 
surface element da, if A is thought of as representing the velocity field 
of a fluid. 

The integral in the numerator of Eq. 56 is then seen to equal the total 
rate at which fluid passes outward through the closed surface. The integral 
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in the denominator of this expression represents the enclosed volume. 
The resulting limit of the ratio of these two integrals yields the divergence 
of A at the point about which the closed surface is shrunk by the limiting 
process. Its value is in general different for different points in space. 

In order for div A to be calculated when the vector function A is 
given, Eq. 56 must be further evaluated. For this purpose, the enclosed 



volume is effectively assumed in the form of a rectangular parallelepiped 
with its center located at the origin of a rectangular co-ordinate system, 
and three of its coterminous edges coincident in direction with the co¬ 
ordinate axes as shown in Fig. 8. If the sides of this parallelepiped are 
identified with the differentials dx, dy, dz, the desired result is at once 
obtained without the necessity of subsequently carrying out the limiting 
process. 

The vector function A is assumed to be finite and continuous in the 
vicinity of the parallelepiped, so that, except for differentials of the 
second order, the variation of A is linear throughout this infinitesimal 
region. If A^, Ay, A^ denote the values of the components of A at the 
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origin, for the surface of the parallelepiped 

-d. - ^ - (-^x - ^ 

which yields 

The enclosed volume is given by 

fdv = dv == dx dy dz [59] 


Hence, in rectangular co-ordinates, Eq. 56 evaluates to 


j. j . 

div A =-h 

dx 


dAy dAz 


[60] 


By means of the Hamiltonian operator defined by Eq. 45, and the 
form for the scalar product given by Eq. 7, the result stated in Eq. 60 
may be written 

div A = V • A [61] 


It is significant that the partial derivatives in Eq. 60 are always to be 
evaluated at the same point in space at which the divergence of A is 
desired. If the result is numerically positive, the point in question is a 
source; if it is negative, the point is a sink. If the result is zero over a 
finite region, the latter is source free. On the other hand, if div A is zero 
throughout all space, it may be concluded either that A is zero everywhere 
or that this vector function describes a field which is purely rotational in 
character.* The possibility that A might be constant throughout all 
space must be discarded on the physical ground that any field must 
vanish at infinity (exceptions to this rule are due to idealizations which 
are physically unrealizable). 


7. Gauss’s law 

According to the definition of the divergence as expressed by Eq. 56, 
*This alternative is considered in greater detail in Art. 10. 
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it follows that 

- da — J *div A dv [ 62 ] 

dosed surface enclosed volume 

Since the integrand in the right-hand integral, namely, div A dv, repre¬ 
sents the fluid productivity for the volume element dv, whence this 
integral yields the total productivity for the finite region, a result that is 
alternately given through integrating the fluid flow over the enclosing 
surface. 

This result, which is known as Gausses law, formally represents the 
transformation of a surface integral into a volume integral, or vice versa. 

It should be observed that the hydrodynamic analogy, used in the 
preceding article to lend concreteness to the definition of the divergence, 
tacitly implies that the ‘‘ fluid ” be incompressible. An arbitrary vector 
function may be likened to the flow of an incompressible or ideal fluid. 
In this light, Gauss’s law becomes almost self-evident, since it states 
merely that all the incompressible fluid produced within a given region 
(this is the volume integral of div A) must issue from the enclosing 
surface. 

Gauss’s law is generally applicable to any vector function for which the 
divergence exists, that is, for which the partial derivatives given in Eq. 60 
can be formed. If this condition is not, the vector function A is in general 
regular and continuous throughout the region involved. When these 
conditions are not fulfilled, the desired transformation may in certain 
cases still be achieved by means of special manipulations to which the 
following discussion is pertinent. 

8. Idealized source distributions 

If the region contains points at which A is infinite or discontinuous, 
the divergence at such points cannot be evaluated by means of the formula 
given in Eq. 60. Such situations occur in practical problems under 
idealized assumptions. For example, it is sometimes convenient to 
assume that a source region is two-dimensional or one-dimensional, or 
even that it has zero dimensions. These idealized source distributions 
are referred to respectively as a surface distribution, a filamental dis¬ 
tribution, or as a point source. 

For the continuous distribution of sources considered in the previous 
article, the source density or productivity per unit volume may con¬ 
veniently be denoted by some symbol such as p, and defined in con¬ 
formance with its analogy to electric charge density by the equation 

div .4 = p [63] 



Art. S] 


IDEAUZED SOURCE DISTRIBUTIONS 


205 


Equation 62 may then be written 

^A • da = Jp dv [64] 

closed surface enclosed volume 

Here the volume integral on the right represents the total productivity 
of the region enclosed by the surface over which the integral on the left 
extends. Equation 64 evidently holds regardless of how the source 
density p is distributed throughout the enclosed region, and hence it is 
possible to assume (if convenient) that the total productivity is con¬ 
centrated at one or more points. These are then referred to as point 
sources. 

In certain physical problems, the actual distribution of source density 
approximates this idealization closely enough to justify such an assump¬ 
tion, and thus a simplification in the resulting mathematical relationships 
for the determination of the field is made available. 

A filamental source density distribution is similarly an idealization 
found convenient in certain types of physical problems. It is significant, 
however, that for the point or filamental types of source distributions 
the concept of the divergence does not apply. External to the points or 
filaments, the divergence is, of course, zero, whereas for points coinciding 
with these idealized sources the divergence as defined above becomes 
infinite. 

For a point source, the total productivity (point charge) may be 
defined by the relation 

e == pdv [65] 

in which the density p is, of course, infinite because e is assumed finite. 
Similarly, for the filamental distribution, a productivity per unit length 
may be defined as 

q pda [66] 

the cross-section of the filament being denoted by da. Here again, p must 
be considered infinite. 

Actually there can be no infinite density p, but the practical examples 
to which the idealizations expressed by Eqs. 65 and 66 apply are such 
that the geometrical relations are closely approximated when the actual 
finite source region or filament cross-section is replaced by the infini¬ 
tesimals dv and da respectively. 

In an analogous manner, a surface distribution of sources is defined 
as having a productivity per unit area given by 

<r == p ds [67] 

in which the differential thickness ds represents the actual small Unite 
thickness of a continuous distribution in the fonn of a layer. 
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For this surface distribution, it is useful to extend the definition of 
the divergence l)y making use of the relations 63 and 64. A differential 
surface element da of the source layer is assumed to have a thickness ds 
which is vanishingly small in comparison with the surface dimensions of 
da. 7'his is a perfectly admissible assumption which in fact adds to the 
preciseness of the definition 67. Fhe integral on the left of Eq. 64, applied 
to the surface enclosing this element, reduces to the flow outward from 
the two opposite faces of the layer element, so that this equation yields 

<j da ^ (Ani + An 2 ) da [68] 

in which An\ and An 2 the outwardly directed normal components of 
A on the two sides of the layer. By analogy to Eq. 63 it is then possible to 
define a so-called surface divergence per unit area, given by 

div, A = <T = Anl + An2 [09] 


9. The scalar potential function associated with a given 

SOURCE DISTRIBUTION 


If .4 is a vector function describing a potential field, it is related to its 
sources by Eq. 63, and to a scalar potential function U by an equation 
similar to Eq. 54. Hence 

div .4 = — div grad U = p [70] 


and it follows that a potential function U may be associated with any 
given source distribution p. 

By means of Eqs. 46 and 61, this relationship may be written 

V • = -p [71] 


and, with the help of Eqs. 44 and 60, the interpretation of this form is 
readily seen to be expressed by 


d^U d-U d-U 

dx^ dy‘^ ^ dz2 “ 


[72] 


Alternatively, the scalar product V • V may be interpreted as the resultant 
operator 


V • V = 


dx^ dy^ dz^ 


[73] 


which yields Eq. 72 when applied to the potential function U. 

The differential operator of the second order defined by Eq. 73 is 
referred to as the Laplacian operator, and the form 


V • Vf/ = 


d^U d^U dHJ 

dx- dy^ 'dz^ 


[74] 
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is spoken of as the “ Laplacian of U." For purposes of abbreviation, 
V • V is alternatively denoted by the symbols and A, so that Eqs. 71 
or 72 are frequently written either as 

= -p [75] 


or as 


Ai; = -p 


[76] 


the latter notation being the simpler but subject to some objection on the 
ground that the symbol A might, according to its more common inter¬ 
pretation, be confused with the notation for an increment. 

The significant point of the present discussion is the fact that a given 
source distribution defines an associated scalar potential function by 
means of Eq. 72, and this in turn determines the associated vector func¬ 
tion A by means of the relation 

^ - grad V [77] 


This view of the relation between the functions A and p may seem to be 
more roundabout than the apparently simple one expressed by Eq. 63, 
but in the solution of many practical problems it proves to be a more 
convenient method of determining A from p, because Eq. 72 involves 
scalar functions only and hence is frequently more easily integrated than 
Eq. 63. Once the function U is obtained, it is usually not difficult to 
determine A from Eq, 77 because doing so involves differentiation only. 

Moreover, there are certain problems in which the source distribution 
p is not known, but, instead, U and its normal derivatives are known 
over boundaries of given geometrical form to which the unknown source 
distribution is restricted. For the solution of these so-called boundary- 
value problemsy the attack by means of Eq. 72 is the only possible one. 
At all points not located on the boundary, p = 0, and this equation reads 


dW d^U dW ^ 

dx^ dy^ dZ^ 


[78] 


A function which formally satisfies this differential equation, and in 
addition meets the stated boundary conditions imposed upon Z7, con¬ 
stitutes the desired solution. 

Equation 72 is known as Poisson's equation, and the corresponding 
homogeneous equation 78 as Laplace's. The latter equation is of im¬ 
portance in connection with any problem in which the mapping of flow 
fields is essential, whether this is accomplished by analytic or by graphical 


*An application of this method to the determination of electric circuit parameters is given 
in Electric Circuitsy Ch. I, Art. 6a, pp. 16 IT. 
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10. The curl of a turbulent* vector field 

In the present article, attention is turned from the potential field to 
what might be called its complement — the turbulent or rotational field. 
Here the flow lines form closed circuits, so that the line integral of the 
vector function A taken around a closed path is in general not zero. 
That is, for a rotational vector function A 

^A • ds 9 ^ 0 [79] 

The seat or origin of a turbulent field lies in its vortexes or whirlpools. 
It is clear that the greater the intensity of the whirlpools in a given 
region, the greater is the value of the integral 79 evaluated for various 
contours within this region. It is, therefore, reasonable to suggest that 
the value of this integral be used as a basis for defining the vortex density 
at any point. 

If the vector A is thought of as representing the force acting upon a 
particle, the integral 79 represents the work done by this force field as 
the particle is allowed to traverse a closed path. The path may, for the 
moment, be thought of as circular, with a radius r. The value of the 
integral 79 divided by 27r then represents an average torque with respect 
to a concentric axis normal to the plane of this circular path. This average 
torque evidently varies with the angular orientation of the axis for a 
fixed location of the center of the circular path. There will evidently be 
one orientation for which the average torque is a maximum. As the radius 
is allowed to shrink until it becomes zero, the maximum average torque 
becomes zero also, but the ratio of this torque to the area of the circle is 
found to approach a finite limit when the force A has finite values. It is 
this limiting value of the ratio of the maximum average torque to the 
enclosed area which thus proves to be a useful measure of the turbu¬ 
lence of the field A at any given point. This value, except for the factor 
27r, is called the curl of A at that point. 

It is not essential for the definition of the curl that the closed path be 
circular. It is essential, however, that this path lie in a plane so that the 
orientation of the normal be clearly defined, for the curl is a vector 
having this same orientation. Thus the curl of A is given in magnitude 

*ln some more recent considerations of hydrodynamic fields, the term turbulent is used to 
designate an entirely random character that specifically does not permit a mathematical 
representation in terms of eitlier the gradient or the curl. Consideration of fields having such 
random character is not included in the present discussion. The term turbulent in this volume 
is used merely as a means of distinguishing the rotational from the irrotational character 
of a held. 
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by the maximum value of 

• ds 

limit [80] 

fja 

_ enclosed surface _ 

as the plane of the contour assumes all possible orientations. In direction, 
the curl of A coincides with the normal to the plane of the contour. 



Fig. 9. An infinitesimal tetrahedron to illustrate the vector character of the curl. 

ix)inting in agreement with the advance of a right-hand screw which 
turns so as to correspond to the traversal of the contour in the evaluation 
of the closed line integral. The vector, curl A, is thus uniquely defined in 
direction as well as in magnitude. 

Just as the divergence of a potential field is at any point a measure of 
the density of its sources at that point, so the curl of a turbulent field 
establishes an analogous relationship between the intensity of that field 
and its vortex density at any point. 

The vector character of the curl may be demonstrated by means of the 
geometrical configuration in Fig. 9, showing an infinitesimal triangular 
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contour ABC whose normal n has an arbitrary orientation relative to a 
reference system of co-ordinates. The sides of this triangle together with 
portions of the co-ordinate axes form the six edges of a tetrahedron with 
vertexes O, B, C. The sides OBCy OCAy OABy normal respectively to 
the X-y F-, and Z-axes, have infinitesimal areas which are denoted by 
dUx) dayy and da^. The area of the side ABC opposite the vertex O is 
denoted by da. Since ddxy dayy da^y are the projections of da upon the 
co-ordinate planes FZ, ZXy and XV respectively, one may write 

1 _ cos (nyx) ^ cos (n,y) _ cos (tiyz) P , 

da ddx day da^ 


in which cos cos cos {Uyz) are the direction cosines of the 

normal n. 

It is likewise clear from the geometry of the configuration that 


J r ^•ds=9 A • ds + <f A ‘ ds + <f A ds 

ABC JOBC Joe A JOAB 


[82] 


inasmuch as the net integration represented by the right-hand side of this 
equation involves traversals in both directions along the edges of the 
tetrahedron emanating from the vertex O (see the circulatory arrows in 
Fig. 9). In terms of the notation 


R = 


J r ^ • ds 

ABC 


da 


[83] 


and 


R. = 


/ 

JOBC 


A • ds 


ddx 


R.= 


/ 

JOCA 


A • ds 


da^ 


R. 


f 

JOAB 


A • ds 


daz 


[84] 


the results expressed by Eqs. 81 and 82 show that 

R = Rx cos (ftyx) + Ry cos (w,y) -f Rz cos (n,z) [85] 

Subject to the condition 

cos^ {nyX) -f cos^ (w,y) *+• cos^ {n,z) = 1 [86] 

the expression on the right-hand side of Eq. 85 attains the maximum 
value 


R,nar = VR.^ + Ry^ + Rz^ 


[ 87 ] 
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for the particular orientation of the normal given by* 

cos {n,x) = cos («,y) = cos (m,z) = [88] 

■^max ^max J^max 

Since the relations expressed by the last two equations are the familiar 
ones existing between a vector and its rectangular components, the 
desired proof is completed. 

It is clear that the curl is an axial vector similar to that representing a 
mechanical torque, the right-hand screw rule serving in both instances to 
relate the rotational motion to the axial direction of the vector. The com¬ 
ponents of this vector with respect to a rectangular co-ordinate system 
may be determined by noting that the component of the curl in any 
direction s is given by 

• ds 

plane contour normal to » 

fda 

encloaed surface 

in which the direction of j is linked with the direction of traversal in the 
line integral by means of the right-hand screw rule. 

The a:-component of the curl is thus found from consideration of a 
closed contour lying in the y^-plane. For convenience, this is taken to be 
the contour of a differential rectangle with its center at the origin, as 





For other applications of the method of determining conditioned maxima see Arts. 4 and 5, 
Ch. IV. 
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illustrated in Fig. 10. Since the co-ordinate axes form a right-hand system, 
the X-axis points upward from the plane of the paper, and the direction 
of traversal of the rectangular contour is as indicated by the arrows. It is 
clear that only the y- and s-components of A contribute to the :r-com- 
ponent of the curl. 

The components of A in the direction of traversal along the sides 1-2, 
2-3, 3-4, and 4-1 may be denoted respectively by A 12 , ^ 23 , ^ 34 , and 
Ay and Ag denote the values of the y- and 2 -components of A at 
the origin, then, -except for differential contributions of higher order 
(assuming A to be finite and continuous throughout the region covered 
by the rectangle), 

. ,dAz dy 


Ao.^ = 


-Ay — 


dAy dz 


A^a — Ag 


dAg dy 


and hence 


. QA y dz 


ds = A 12 dz + A23 dy + A%i dz + At,\ dy 


/ dA, _ 

\ dy dz J 


According to Eq. 89, the «:-component of curl A, therefore, becomes 





In an analogous fashion, or through simply 
advancing the cyclic order of the letters y, 2 , 
the y- and 2 -components of curl A are found to be 


H— dy —H 

Fig. 10. A differential 
rectangle centered at the 
origin. 


curly A 


cmlgA = 


Comparing the turbulent with the potential field again, it is interesting 
to observe the significance of the conditions under which 


[ 95 ] 
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According to the discussion in Art. 5, these conditions are stated by 

A = — grad U [96] 


or 


Now since 


A.= - 


^ A A - 

ax “ ay * ” 


3 ^ 

az 


a^U d^u 


■ > etc. 


[97] 


[98] 


dx dy dy dx 

it follows that the conditions 97 may alternatively be stated in the form 


^ = 0 
dy dz 

[99] 

aAx _ dAx _ Q 
dz dx 

[100] 

dAy dAx _ Q 

dx dy 

[101] 


The expressions on the left-hand sides of these equations are the com¬ 
ponents of curl A given in Eqs. 92, 93, and 94. Hence it is seen that 

curl A = 0 [102] 


becomes the necessary and sufficient condition for the vanishing of the 
line integral as expressed by Eq. 95. 

If over a given region the curl of A vanishes at all points, the line 
integral of A for any closed path within this region vanishes also,* and A 
may there be represented as the gradient of a scalar potential function 
as expressed by Eq. 96. Conversely, if the vector function A is the gradient 
of a scalar, its curl must be zero; that is, A must be nonturbulent. The 
gradient then, has no curl. In symbols, 

curl grad U ^0 [103] 


This statement is verified through substituting the relations 97 into the 
Eqs. 99, 100, and 101. 

It is useful to observe that the components of curl A given by Eqs. 92, 
93, and 94 may be combined into a single compact vector expression by 
means of the determinant form 


curl A 


i j k 

_i. A A 

dx dy dz 

Ax Ay Ax 


[104] 


*This statement Is subject only to the restrictions pointed out in Art. 14^ which need not 
be conrJdcred at the moment. 
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The Laplace development of this determinant for the elements of its 
first row is readily seen to yield 

i curl, A + j curly A + k curl, A [105] 

in which the respective components are the expressions 92, 93, and 94. 

By recalling the determinant form 25 for the vector product and the 
definition of the Hamiltonian operator V as given by Eq. 45, it is recog¬ 
nized that an alternative compact form for curl A reads 

curl A = V X A [106] 

In summary, the three important vector operations, gradient, diver¬ 
gence, and curl, are seen to be expressible in terms of the Hamiltonian 
operator, thus 

grad U — VU 

div ^ = V • .4 [107] 

curl A = Vx A 


11. Stokes’s law 

According to the definition of the curl as expressed by Eq. 80 or in 
component form by Eq. 89, it follows that 

^ A ■ ds = ^(curl i4) • da [108] 

any closed contour any surface bounded 
by that contour 

This result, which is known as Stokes’s law, formally represents the 
transformation of a closed line integral into a surface integral, or vice 
versa. Stokes’s law is the counterpart of Gauss’s law in the sense that it 
expresses for the purely rotational field what Gauss’s law expresses with 
reference to the potential field. 

It should be observed that the closed contour in Eq. 108 is not restricted 
to lie in a plane, and that the surface bounded by this contour may have 
any shape. For example, the contour may be visualized as a warped hoop 
and the surface as that of a rubber membrane bounded by the hoop but 
allowed to be stretched out sideways into any form whatever. If the 
hoop is thought of as being moderate in size, one may consider blowing 
the rubber membrane out sideways until it becomes inflated like a 
balloon, which may bulge backward over the ring, etc. 

The vector surface increment da, which is normal to the surface, points 
in that direction which is determined from the direction of traversal of 
the boundary by the right-hand screw rule. This correlation is shown in 
Fig. 11. In Fig. 12 the surface is for convenience drawn as a plane. The 
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scalar product (curl ^) • da equals the line integral of A for the closed 
boundary of any one of the surface elements. The surface integral repre¬ 
sents the sum of all these elemental closed line integrals. This sum 


dosed 

Contour 




Fig. 11. Correlation of contour traversal with 
element traversal when bounded surface does not 
lie in a plane. 


Fig. 12. The closed line 
integral equals the sum of 
the elemental line integrals. 


evidently equals the line integral around the large boundary because the 
common boundaries of the surface elements are traversed in both direc¬ 
tions and their contribution to the surface integral is zero. Thus the 
validity of Stokes’s law, as stated by Eq. 108, is established. 


12. The vortex distribution of a turbulent field 

For the turbulent field, it is convenient to define a vortex density J by 
means of the relation 

curl A ^ J [109] 

in which J is analogous to the current density occurring in the study of 
electricity and magnetism.* Stokes’s law, Eq. 108, then yields 

^^•ds = 

closed oonlotir enclosed sxirface 

Equations 109 and 110 arc analogous to Eqs. 63 and 64. They relate the 
turbulent field to its vortex distribution J just as the potential field is 
related to its source distribution p. The vortex density J is the cause of 
the turbulent field just as the source density p is the cause of a potential 
field. 

The essential difference is that p is a scalar function of the space co¬ 
ordinates whereas J is a vector function. In general, J is a finite and 

*In this analogy the vector function A represents the magnetic field intensity and should 
not be confused with the magnetic vector potential which is customarily denoted by the 
letter A, 
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continuous function; that is, the vortexes are thought of as continuously 
distributed over certain regions just as the source density p is in general 
continuously distributed. In certain practical problems, however, it is 
convenient to idealize the vortex distribution. The situation is again 
analogous to the idealized source distributions discussed in Art. 8, except 
that there is no vortex analogue of the point source.* 

There is, however, a vortex analogue of the filamental source distri¬ 
bution. It is spoken of as a vortex thread. The amount I of the vortex 
thread is defined by the relation 

I^Jda [111] 

in which da is written in place of the actual finite cross-section of the 
filament. Since I is finite and da differential, this idealization requires 
the concept of an infinite vortex density J. The latter, as well as the 
vector /, is everywhere directed tangentially to the filament. The vortex 
thread may be thought of as a filament along which are concentrated 
whirlpools of infinite intensity, and about which a fluid is set into a 
swirling motion. The central portion of a tornado or “ twister,” and that 
of a ‘‘ waterspout,” are hydrodynamic examples permitting an idealized 
representation by means of a vortex thread. 

A surface distribution of vortexes may be thought of as the result of 
many threads placed side by side like the warp in a weaver’s loom. The 
vector moment I has the same value and direction for all the threads. 
A surface density g may here be defined by the relation 

g = Jds [112] 

in which ds represents the thickness of the surface or layer. There is no 
whirling action aroimd the individual threads, that is, through the sur¬ 
face, because of the cancellation of this action along adjacent sides of the 
threads. The vortex surface merely causes a translatory motion of fluid 
in opposite directions along its two sides. Thus the tangential component 
of the vector field A is observed to change suddenly as the point of 
observation is shifted from one side of the vortex surface to the other at 
any given point. 

Figure 13 shows the vortex surface in cross-section, the cut being 
parallel to the tangential components of A and at right angles to the 
direction of g. The line integral in Eq. 110 is evaluated for the closed 
rectangular path with the differential sides ds and dL Here ds is assumed 
to be so small compared to dt that the corresponding contributions to 
the line integral are negligible in comparison with those for the sides dt. 

*In this connection it may be observed that one does have a vortex analogue of the double 
point source (the doublet or dipole), namely, the vortex ring. 
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Equation 110 then yields 

{All — At 2 ) dt = Jdsdt - g dr [113] 

in which An and At 2 are the tangential components of A on the two 
sides of the surface. 

By analogy to Eq. 109, it is then possible to 
define a surface curl per unit length (in the dr di¬ 
rection), given by 

curl,yl = g = An - At 2 [114] 

This vector points upward from the surface of the 
paper (the assumed Erection of the vortex density 
g) in Fig. 13. If «i 2 denotes a unit vector normal 
to the vortex surface pointing from side 1 to side 2, 
the direction of the surface curl is contained in the 
right-hand screw rule for the vector product in the 
definition 

curl, A = g = (An - At2) » ni2 [US] 


At2 

ni2 

r 


vortex 

surface- 


ir 


closed 

path 


-ds 


Fig. 13. A vortex 
surface in cross 
section. 


13. The vector potential punction associated with a given 

VORTEX DISTRIBUTION 


The present article seeks to show that the vortex distribution of a 
turbulent field determines a vector potential function in a manner 
similar, except for certain anti-parallelisms, to that relating a scalar 
potential function to the source distribution of a potential field, as dis¬ 
cussed in Art. 9. 

The first step in this argument is to observe that if Stokes’s law, Eq. 
108, is applied to a closed surface, the line integral on the left-hand side of 
this equation is zero. This fact may be visualized through first considering 
the surface to be balloon shaped and the closed contour or boundary to 
be the small loop located at the throat through which the balloon is 
inflated. As this loop is contracted until the balloon is finally tied off, the 
dosed contour shrinks to zero and the line integral vanishes. 

According to Gauss’s law, Eq. 62, it follows, therefore, that 


^(curl A) • da = J div (curl A) dv = 0 


oloBed surface 


enoloaed volume 


[116] 


Since the size of the enclosed volume is arbitrary, it may be considered 
to be infinitesimal; whence this result yields 


div curl A ™ 0 


[117] 
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The conclusion is that the vector field given by the function curl A is 
source-free; in other words, curl ^4 is a purely turbulent vector field. This 
conclusion is true for any vector function A. The relation 117 is an 
identity. 

The curl tkeriy may be said to have no divergence. This statement is the 
complement of the one made in Art. 10 to the effect that the gradient has 
no curl. Whereas the gradient function represents a pure potential field, 
the curl represents a purely turbulent field. 

The identity 117 may readily be checked independently through 
substituting the components of the curl given by Eqs. 92, 93, and 94 for 
the components A^^ A A z in the expression for the divergence as given 
by Eq. 60. 

If a given vector function B is known to represent a purely turbulent 
field, that is, if 

divB = 0 [118] 

the result just obtained permits the function B to be expressed as 

B = curLl [119] 

the thought being that the vector function A is thereby specified in terms 
of Bj or vice versa. Here it must be observed, however, that whereas B 
is uniquely determined in terms of A by means of Eq. 119, the reverse 
is not true. 

This operation is readily appreciated from the fact that if the vector 
function A is assumed to be perfectly general, it may represent a field 
which exhibits both potential as well as turbulent characteristics. In 
other words, A may be represented by 

A==T + P [120] 

in which T is the source-free (or turbulent) component of A, and P is its 
curl-free (or potential) component, that is 

div r = 0 
and 

curl P = 0 

Substituting the expression 120 for A into Eq. 119 yields 

B = curl T [123] 

because of the relation 122. 

It thus becomes clear that Eq. 119 alone does not determine the whole 
function i4, but only its source-free component. If the vector function A 
is introduced by Eq. 119 merely tor convenience, that is, as an auxiliary 
function in the course of an analysis, this difficulty may be overcome by 


[ 121 ] 

[ 122 ] 
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the further demand that 

div ^ = 0 [124] 

The vector function A is then uniquely characterized in terms of B by 
means of the two relations 119 and 124. 

This situation is similar to having given a purely potential field F, 
and assuming that a scalar potential function V may thereby be defined 
in terms of the relation 

F = - grad U [125] 

In this case, U is determined only within an additive arbitrary constant, 
since the gradient of the latter is zero. Just so, Eq. 119 determines A only 
within an additive arbitrary vector function representing a potential 
field, since the curl of the latter is zero. Setting the constant component 
of U equal to some chosen value (for example, zero) is analogous to 
setting the divergence of A equal to zero in the present discussion.* 

It may now be supposed that the given source-free field represented by 
B has a vortex distribution described by the vector function /; that is 

curl B = J [126] 

From Eq. 119 it then follows that a vector function A is related to this 
vortex distribution by means of the equation 

curl curl A = J [127] 

subject to the condition expressed by Eq. 124. 

The function A which is thus related to a given vortex distribution J 
by means of Eqs. 124 and 127 is called the vector potential associated with 
B, because it plays the .same role relative to B and its vortexes that the 
scalar potential U plays relative to the associated nonturbulent field F 
and its sources. If the vector potential A is found from a given vortex 
distribution J by means of Eqs. 124 and 127, the turbulent field B is 
determined from Eq. 119. This method of determining B from J, al¬ 
though apparently roundabout, is frequently found to be more con¬ 
venient than that of attempting a solution directly in terms of Eq. 126. 

It is necessary to interpret further the repeated curl operation in Eq. 
127, as is readily done by means of Eqs. 92, 9.3, and 94 for the components 
of the curl. Thus the x-component of curl curl A is seen to be given by 

^ _ 
dy \ 3x dy ) fls\ 32 dx ) 

4. n ool 

dxdy dy^ dz^ ^dxdz ^ ^ 

'"Any other disposition of the value of div /I, appropriate to the circumstances pertaining 
to a specific problem, may likewise be made. 
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Adding and subtracting from this expression the term-^^» and ap¬ 
propriately grouping the result, show that 


curl* (curl^) 


_ A ^ -t- — 

da:\ dx dy dz 


') 




3®^* . d*^* . 8^A.. 


+ 


dx^ ■ d'f 

By means of Eqs. 60 and 74, this may be written 


+ 




curl* (curl^) = — (div^) — 
ax 


[130] 


in which V® is the Laplacian operator defined by Eq. 73. 

The y- and 2 -components of curl curl A are foxmd in a like manner, or 
more simply through advancing the cyclic order of the variables x,y,z in 
Eq. 129. The result is 

curl curl A = (i-^ +j + k j (div ^4) 

\ dx dy dz) ’ 

— V^(t.4* jAy •+• kA,'i [1^^] 

which is 

curl curl A = grad div A — div grad A [132] 

or 

curl curl id = V(V-i4) — V^A [133] 

It is interesting that although the gradient of the vector fimction A is 
not defined,* the Laplacian of id, or div grad id, is interpreted according 
to Eq. 131 as 

div grad id = V*id = i V^id* +jV’‘Ay + k V^id, [134] 

Equation 127, subject to the condition 124, is now seen to yield the 
equation 

V*i4 = -/ [135] 

relating the vector potential associated with B to its vortex distribution. 
The nicety of this result is that it is identical in form to Eq. 75 relating 
the scalar potential U to the source distribution p of a nonturbulent field. 
The only significant difference is that Eq. 135 involves vector functions 
whereas Eq. 75 involves scalar functions. This fact means that the vector 
equation 135 is equivalent to three scalar equations of like form, one for 
each of the three corresponding components of A and J. 

•An interpretation of the gradient applicable also to vector functions is given in Art. 15 
of this chapter. 
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14. The possibility of a multivalued potential function 

It has been shown that if, throughout a given region, a vector field A 
is conservative so that curl A is identically zero at all points within this 
region, A may there be expressed as the gradient of a scalar potential 
function V. Furthermore, it has been pointed out that the existence of such 
a potential field is in general due to a distribution of sources which, ac¬ 
cording to the hydrodynamic analogy, are fluid-producing regions. One 
may be tempted to conclude, therefore, that a potential field can be due 
only to sources, and never to vortexes, because these latter are regions of 
turbulence and hence can produce only turbulent fields. 

A moment’s reflection, however, yields the thought that if a distribu¬ 
tion of vortex density J is confined to a finite region of space, only within 
that region is the curl of the associated vector function A different from 
zero. Everywhere else the curl of A is zero, and the field is, therefore, 
potential (that is, conservative) in character. 

A very important distinction, however, should be made between the 
conservative field which is due only to pure sources, and that which is due 
to vortex distributions restricted to certain excluded regions of space. To 
state the matter in another way, it is important to distinguish between a 
field which is conservative throughout all space and one which is conserva¬ 
tive only within certain portions of space, or to the exclusion of certain 
portions. The field which is conservative everywhere can have its origin 
in true sources only, whereas the one which is conservative within re¬ 
served regions (finite or infinite in extent) can be due to vortexes as well 
as to sources, although the former are confined to lie outside the reserved 
regions. 

This distinction is concerned primarily -with the nature of the associ¬ 
ated scalar potential function U. Thus, if the field is conservative 
throughout all space, or throughout a simply connected region S (see 
Fig. 14), the associated potential function U there is single valued; but 
if the region over which the field is conservative is a multiply connected 
one (Fig. 15), the associated potential becomes a multivalued function. 

A region is said to be simply connected if for every closed contour lying 
entirely within the region a surface bounded only by that contour can be 
constructed such that every point of the surface also lies within the region. 
The significance of this statement is best understood from an example of a 
region which is not simply connected. Thus the space outside a doughnut¬ 
shaped region is not simply connected because a closed contour which 
links the doughnut (passes through the hole) cannot form the sole 
boundary of a surface every point of which is required to lie outside the 
doughnut. If the doughnut is cut so that it no longer forms a closed ring, 
the space becomes simply connected. With the doughnut intact, the 
surrounding space is said to be doubly connected. 
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Another illustration of a doubly connected space is that surrounding a 
closed cylindrical surface of infinite extent like a straight tube which is 
infinitely long in both directions. Here a contour which encloses the 
cylinder cannot form the sole boundary of a surface which lies wholly 



outside the cylinder. If the space enclosed by the cylindrical surface is 
filled with vortexes whose cross-sectional distribution is given by the 
vector density J (directed longitudinally), then, since by assumption 
7 = 0 outside the cylinder, the associated field function A satisfies the 
equations 

curl .4 = 7 [136] 


within the cylinder, and 

curl .4=0 [137] 

outside the cylinder. 

In the region outside the cylinder it is, therefore, possible to assume 

4 = - grad U [138] 




Aft. /4\ 


A MULTIVALUED POTENTIAL FUNCTION 


223 



cjonnecting tube d can be used instead of a but not both at the same time, 
the connecting tubes, of infinitesimal cross-section, are the 
so-called barriers of the region 

Fig. 15. A multiply connected region. 


With reference to Fig. 16, which shows a cross-section through the 
cylinder, the line integral of A formed for the closed path Px is evidently 
zero because it does not enclose the vortex region. This fact follows 
readily from Stokes’s law. However, for the closed path P^ the same law 
yields 


^Ads = J'/da = / 


[139] 


But by Eq. 138 


^ A • ds = — ^ (grad (7) • ds 


and hence it follows that 



-7 


[140] 


[141] 


If the line integral is thought of as extending from some point a on the 
path P‘i, around the closed contour back to the same point a, this result 
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indicates that 

f (grad U) ds^ Ua- I [142] 

JPt 

in which Ua is the value of the potential U at the point a. The only 
possible conclusion to be drawn from Eq. 142 is that the potential func¬ 
tion U is not uniquely defined for points in the space surrounding the 



Fig. 16. One path of integration which encloses a vortex; another which does not. 


region enclosed by the cylindrical surface. Indeed, if the line integral is 
extended twice around the contour P2, the result is 

Ua-Ua^ 21 [143] 

and for n circuitations 

Ua-Ua^ nl [144] 

The potential U at any point such as a clearly is defined only within an 
additive integer multiple of /. This is the nature of the multivalued 
potential function U in this example. 

The structure of the space surrounding the cylindrical region may be 
thought of as composed of leaves lying in the cross-sectional plane and 
winding about the cylinder as a winding stairway encircles a column. 
The density of these leaves longitudinally is infinite so that the process of 
encircling the cylinder any finite number of times around the contour 
P 2 without piercing any leaves involves no net longitudinal motion. Any 
point such as a is then referred to as ai, a 2 , as, • • • etc., according to an 
assumed numbering of these hypothetical leaves, and Eq. 144 may then 
be written more precisely in the form 

- U., = nl [145] 

Although the multivalued potential function U may, through such a 
mathematical artifice, be transformed into a single-valued one, the rather 
complicated interpretation of the space outside the cylindrical region is 
given here principally for the purpose of lending visual clarity to the 
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concept of multivaluedness. A practical problem involving these concepts 
arises in the subject of magnetostatics where the cylindrical region is 
identified with a current-carrying conductor, the density of the electric 
current being J, whereas the total conductor current has the value I. 


15. The differentiation of scalar or vector functions with 

RESPECT TO THE TIME 


A given vector function A is considered to be a function of the space 
co-ordinates *, y, z and also of the time I, that is, 

A A (x,y^,t) [146] 

The behavior of this function is studied at some point P in space, having 
the co-ordinates x, y, and z. More sp>ecifically, this point is denoted by 
P{x,y,z). This notation may refer to any specific point if proper values are 
assigned to x, y, and z. P is also referred to as “ the point of observation.” 

In considering the time derivative of A at the point P, or the rate at 
which the vector A changes with respect to the time at the point of 
observation, two possibilities must be distinguished, according to whether 
the point of observation is stationary or is in motion relative to the refer¬ 
ence co-ordinate system. In the former case, the variables x, y, and z are 
constant, and in the latter they are functions of the time — that is, the 
point P moves with a velocity v given by 

V ivx + jvykog [147] 

with 




dx 

Ti 




[148] 


If the point P is stationary (*, y, z are assumed constant), the time 
derivative of A is understood to be the partial derivative dA/dt-, if P is 
not stationary, the time derivative of A is given by the total derivative 
dA/dl. 

Identical remarks apply to the time derivative of a scalar function U, 
which may, for example, be the potential energy of a particle located at 
the px)int P. If the particle is stationary, the potential energy may change 
with the time because of a time variation of the field in which it is em¬ 
bedded. This p>ossibility is denoted by the partial derivative dUjdt. If 
the particle is in motion, the net rate of change of its potential energy 
with respect to the time is denoted by dU/dt, and is in general due to the 
combined effects of the time variation of the field in which the particle 
is embedded and of the particle’s own motion through this field. 

Neglecting differential effects of higher order than the first, the total 
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time derivative of the scalar function U is expressed by 
dU dU dU dx dU dy dU dz 
lu ~ ~^'di ^ ~dz~dt 


[149] 


The first term on the right-hand side of this equation represents the time 
variation of U on the assumption that the particle at the point P is 
stationary. The sum of the remaining three terms represents the time 
variation of U due solely to the motion of the particle through the field 
which (as far as 'these terms are concerned) is constant at any fixed 
point but varies from point to point. The net time variation dU/dl 
appears as a linear superposition of these two separate effects because 
the contribution of higher order derivatives may (according to the 
principles of the differentia calculus) be neglected. 

According to the definitions of the gradient and the scalar product, 
Eq. 149 may be written in the form 


dl 


ATI 

“7 + » ■ grad U 

dl 


[150] 


in which the velocity v of the point of observation is defined by Eqs. 147 
and 148. If U is not an explicit function of the time — that is, if f/ is a 
function of the space co-ordinates alone — dU/dt = 0, and dU/dt is 
given by the second term in Eq. 150 alone. This term equals the com¬ 
ponent of grad U in the direction of v, multiplied by the magnitude of v. 
In other words this term equals the space rate of change of U in the direc¬ 
tion of V, multiplied by the magnitude of v. It is convenient to regard this 
as a resultant operation upon the function U by defining the operator 


(w • grad) = (zi • V) = 


d_ 

dx 


-\-Vy— -It 

dy 


dz 


and by writing Eq. 150 


dt 


dt 


-f (v ■ V)U 


[151] 

[152] 


The vector v in the operator defined by Eq. 151 may be replaced by any 
vector function B, and (B • V) is then referred to as the “ B-gradient.” 
The symbolic operation (B ■ V)U is read:_ “The .B-gradient of (/.” 
Unlike the gradient of U, it is a scalar quantity. 

The convenience resulting from defining this operator is seen when the 
operator is used in connection with a vector function A. Whereas the 
gradient of a vector function cannot be interpreted according to the 
definition of this vector operation, the B-gradient is readily seen to be 
applicable to vector functions, and yields a vector, thus 

(B • V)A = i{B • V)A, -!-y(B • V)Ay -h k{B • V)A. [153] 
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in which the ^-component reads 


(B • VM, = B • = Bx 


dx 


+ B.^ + 5. 


a^x 

dz 


[154] 


Similar expressions apply to the y- and z-components. 

The total variation of a vector function A with the time is, therefore, 
given by the expression 


dl 


— +(:/• V)^ 
dl 


[155] 


This is, in general, a function of the time. At any given instant, the vector 
{v ■ V)A represents the space rate of change of A in the direction of v, 
multiplied by the magnitude of v. To state the case in another way, 
(v ■ V)A is the vector change (increment) of A per unit displacement of 
the point of observation in the direction of v, multiplied by the magnitude 
of V. 

A purely algebraic interpretation of the operation (v ■ V)A is obtained 
by letting 

(v • V)A = G = iGx A- jGy -|- kGz [156] 

Then 


SAx dAx dAx — 

Vx + —— Vx = Gx 

dx dy dz 


dA 


dx dy 


+ 


djj 

dz 


Vx — Gtj 


[157] 


dAx 

dx 


Vx + 




Gx 


The operation is thus recognized as amounting to a linear transformation 
of the vector v. If for abbreviation one writes 


dA, 


dA, 


dA, 


dxx ~ 


dxy = 


dxy — 


dx dy ' *' dy 

then the matrix of the transformation is 


a 


dxx dxy dxx 
= dyx dyy dyx 

_dxx dxy dxx_ 


dxx = 


dAx 

dz 


[158] 


[159] 


The operation {v • V)j 4 is thus regarded as a tensor of valence 2, which 
associates a vector G with a given vector v at any p>oint in space. The 
elements of the matrix Q, defined by Eq. 158, are the components of this 
tensor. Their values depend upon the vector function .4. C is said to be a 
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linear vector function of v, the characteristics of this relationship being 
determined by the nature of A, 

In passing it may be of interest to note that the operations of forming 
the curl or a vector product may also be regarded as linear vector trans¬ 
formations. Thus the vector, curl A , is expressible as a linear transforma¬ 
tion of A with the skew-symmetrical operator matrix 


0 

b 

b 

bz 

by 

d 

dz 

0 

b 

bx 

d 

b 

0 

by 

bx 


[ 160 ] 


and the vector product ^ 5 is expressible as a linear transformation of B 
with the skew-symmetrical matrix 


0 -A;, Ay 

A^ 0 -A^ 

— Ay Ax 0 


[ 161 ] 


The time derivative of the product of two vector functions is evaluated 
according to the familiar rule for the differentiation of a product. For the 
scalar product, the result reads 


d . dA dB 


[ 162 ] 


and similarly for the vector product 

dA 




dB 


[ 163 ] 


in which it is important to preserve the order of the two functions. 


16. Additional useful vector relations 

Although the discussions of the preceding articles suffice to determine 
the results of more complicated operations involving combinations of 
scalar and vector functions, it is useful to have available several additional 
formulas covering those relationships which are encountered more fre¬ 
quently in practical problems. The following items are concerned with 
derivations of this sort. 

(i) The divergence of the product of a scalar and a vector. 

The scalar function is denoted by U and the vector function by A. 
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Then 

div {UA,) H- ^ {UAv) + ^ i-UAz) [164] 

By the rule for the differentiation of a product, this is seen to yield 

div {UA) = U div A + A • grad U [165] 

(ii) The curl of the product of a scalar and a vector. 

Here the rule for the differentiation of a product may be expressed in 
the following way: 

curl {UA) = Vx (f7^) = Vx {UA)u + V^{UA)a [166] 

in which the subscripts mean that the functions Z7 or ^ are to be treated 
as constants. According to the definition of the curl by Eq. 104 it is 
readily seen that 

V-{UA)u ^ U cuAA [167] 

and 

V X {UA)a = -A X grad U [168] 

Hence 

curl (UA) = U curl A -A^ grad U [169] 

(iii) The divergence of a vector product. 

This may be written 

div [.4 X B] = V • [A X B] = V • [A X 5]^ + V • [A X B]b [170] 

the subscripts having the same significance as before. From Eqs. 26 and 

38, 

V • [A X B]a = —A • [V X B] = —A ■ curl B [171] 

V • [.4 X B]s = B • [V X A] = B • curl A [172] 

so that 

div [A X B] = B • curl A — A ■ curl B [173] 

(iv) The curl of a vector product. 

Here 

curl [A X B] = V X [A X B] = V x [A * B]^ + V x [A x B]jj [174] 
Applying Eq. 32 for the triple vector product gives 

Vx [A xB]x = A(V-B) - • V)B [175] 

and 

17x[^ xB]b = (B-VM - B(V-A) [176] 
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The operations ^4-gradient and 5-gradient are defined by Eq. 151 in the 
previous article. Thus 

curl [.4 X 5] - ^ div 5 - 5 div ^ -h (5 • V)^ ~ {A • V)B [177] 

(v) The vector product of a vector and the curl of another vector. 

Here Eq. 32 is applied to the triple vector product 

A X curl B = ^ X [v X j5] [178] 

the vector function A being treated as a constant. Thus one obtains 

^ ; [V X B] = v{A •B)a- {A^ V)B [179] 

or 

A X curl B = grad (A • B)a — (^4 • V)B [180] 

(vi) The gradient of a scalar product. 

This reads 

grad (.4 • 5) = grad {A • B)a + grad {A • B)b [181] 

By Eq. 180, 

grad {A • B)a — A^ curl 5 -f • V)5 [182] 

grad {A • B)b = 5 x curl ^ -f (5 • V)i4 [183] 

Hence 

grad {A • B) — A>^ curl 5 + 5 x curl ^4 + (^ • V)5 + (5 • V)A [184] 

(vii) The volume integral of the scalar product of a potential and a solenoidal 
vector function. 

A purely potential field is described by the vector function A, and a 
purely turbulent field by the vector B\ that is, 


curl A = 0 

[185] 

divB = 0 

[186] 


throughout all space occupied by these fields. In the volume integral 

/w • B) dv [187] 

which is extended over all space, or over that* portion to which the field 
B may be confined, the element of volume dv is represented by an ele¬ 
mentary length ds of any one of the closed tubes characterizing the flow 
map for the solenoidal field B. If the cross-sectional area of a flow tube 
is denoted by da, the integral 187 may be written 

■B)dv = f f \B\ da {A • ds) 


[188] 
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Here the vector element of length ds of a flow tube has the same direction 
as B. The integration with respect to ds extends around the closed circxiit 
of a flow tube, and the integration with respect to da extends over all the 
flow tubes. 

According to the definition of a flow tube, |5| da is constant through¬ 
out the closed circuit mapped by this tube, so that this factor may be 
placed before the integral with respect to ds. Hence 


J'iA B)dv = J*\B\da^A- ds 

[189] 

Since A defines a potential field, it follows that 


o 

II 

[190] 

so that the final result reads 


o 

II 

s 

[191] 



17. The vector r 

In connection with many field problems it is convenient to introduce 
a vector r which represents the vector distance between two points P 
and Q in space as shown in Fig. 17. The point Q may be the location of a 
cause (such as a source or vortex) whereas P is the point at which the 
resulting field is observed. The vector r is assumed to point from Q to P. 
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Hence if the co-ordinates of Q are denoted by f, and those of P by 
X, y, z, the components of r are given by 

r,= ix- {), ry= {y- ri), r, = (2 - f) [192] 

and the vector r is 

r = i{x - 0 +j(y - v) + - f) [193] 

The magnitude of r is expressed by the scalar function 

f = V(* - f)"* -h (y - nT +{z- [194] 


In discussing various operations in terms of either the vector r or the 
scalar function r, a distinction must frequently be made according to 
which of the points P or Q is considered to be variable. If Q is fixed and P 
variable, the operations of differentiation or integration apply to the 
co-ordinates x, y, z. This state of affairs may be indicated by attaching a 
subscript P to the operator in question. Similarly, a subscript Q indicates 
that P is considered fixed, and the variables f, > 7 , f, are affected by the 
operator. For example. 


whereas 


,_ai_ 

dx 




1 -h « — 

dy dz 

[195] 

7 — ” 1 “ k — 

■'dr, dt 

[196] 


Similar distinctions apply to the operator div and curl. 

Because of the symmetrical manner in which the variables x, y, z on the 
one hand and {, ij, f on the other, enter into the expressions 192 for the 
components of r, the difference between a given operation as ev^uated 
for the subscripts P and Q is readily recognized. Thus, for the operations, 
grad, div, curl, for example, the result for a subscript P is simply the 
negative of that for a subscript Q. 

In the following more specific discussion, therefore, the variables are 
always assumed to be x, y, z. Without loss in the generality of this dis¬ 
cussion, the fixed point Q may then be assumed to be coincident with the 
origin of co-ordinates. This simplifies the expressions 192,193, and 194 to 


11 

II 

M 

II 

[197] 

r = t* -|- jy -h kz 

[198] 


[199] 
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In terms of these expressions it is readily seen that 

, . dr dr ,, dr 1 .. . . , , . r 

grad r = t—+j— + k — = - (tx+jy + kz) = - [ 200 ] 

ox oy dz f T 

In other words, the gradient of the scalar function r is equal to a unit 
vector in the direction r. 

For the evaluation of the gradient of a function of r, it is useful to 
observe that 

_ d / .dr dr ^ 7 ^A 1 

Hence if/(r) denotes a function of r, and the partial derivative df/dr is 
written/'(r), 

grad f(r) = / (r) grad r = / (r) - [ 202 ] 

T 

For example, if 

/(r) = r” [203] 

then 

grad f" = [204] 

An application of this result to a commonly occurring form reads 

grad 0^ = - ^ [205] 


According to Eq. 60, the divergence of the vector function r is 


dr* 

div r = 

dx 


dry 


and with Eq. 197 this gives 


dy 
div r = 3 


dz 


From Eq. 165 it follows that 

div (r"r) = r” div r + r • grad r” 

By substitution from Eqs. 204 and 207, this yields 

div (r"r) = (« + 3)r’* 

This result, together with Eq. 204, shows that 

div grad r" = vV” = »(n + l)r"~^ 

In particular, for » = - 1, this gives the important result 


[206] 

[207] 

[208] 

[209] 

[ 210 ] 
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Evaluating the curl of the vector function r by substituting the com¬ 
ponents 197 into Eq. 104 shows that 

curl r = 0 [212] 

and the use of Eq. 166 then shows further that 

curl (r^r) = 0 [213] 

In particular, 

curl = 0 [214] 

The vector function r, or (f"r), may be looked upon as defining a pure 
potential field. 

A number of vector relations formed from the function r in combination 
with an arbitrary vector function A are also useful. Using the result 
expressed by Eq. 184 together with Eq. 212 yields 

grad {t • A) = r x curl A + (t • V).4 -f (A • V)r [215] 

But 

(A.V)..(A^l + A.^ + A.^)r=A [216] 

SO that 

grad (r • A) = r x curl A + (t • V)A + A [217] 

Equations 173 and 212 show that 

div [t “A] — — r • curl A 
Whereas Eqs. 177, 207, and 216 yield 

curl [r X A] — r div A — 2A — (t • V)A 

18. CUKVILINEAR CO-ORDINATES 

Because of the geometry inherent in some physical problems, it is 
advantageous to designate various points in space in terms of co-ordi¬ 
nates other than the rectangular Cartesian ones which have been used in 
this discussion so far. In a problem which exhibits cylindrical symmetry, 
for example, it is usually effective to use cylindrical co-ordinates; if the 
physical problem has spherical symmetry, spherical polar co-ordinates 
are usually preferable, and so on. 

The variables occurring in connection with any of these curvilinear 
co-ordinate systems may be denoted by u, v, w, as contrasted with the 
variables x, y, z, used for the rectangular Cartesian system. In the 
Cartesian system the curves for constant values of y and z, z and x, and 


[ 218 ] 

[ 219 ] 
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X and y form mutually orthogonal families (which in this instance are 
straight lines). For this reason, the rectangular Cartesian co-ordinates 
are said to be orthogonal. 

In a curvilinear co-ordinate system, the curves for constant values of 
V and w, w and «, and u and v may also form mutually orthogonal fami¬ 
lies, for example, in the case of cylindrical or spherical polar co-ordinates. 
The curvilinear co-ordinates are then said to be orthogonal. The dis¬ 
cussion of the present article is restricted to systems of this sort since the 
need for a more general system very rarely arises in practice. Moreover, 
the mathematical apparatus necessary for dealing with perfectly general 
curvilinear co-ordinates — the absolute differential calculus — requires a 
detailed study of considerable depth, which seems warranted only when 
sufficient use for it in connection with other practical problems presents 
itself. 

For the orthogonal curvilinear co-ordinates, a set of mutually orthogo¬ 
nal unit vectors 4, are defined which are analogous to the vectors 
i,j, k in the Cartesian system. The unit vector at any point in space is 
tangent to the curve v = constant, w = constant, at that point. Simi¬ 
larly, iv is tangent to the curve w — constant, u = constant, and fu> is 
tangent to the curve u = constant, v = constant. The directions are, 
moreover, so chosen that iv, iw form a right-hand system. 

It should be observed at this point that the scale of length which is 
implied in the designation of f„, iv, iw as unit vectors is that pertaining 
to the rectangular Cartesian co-ordinate system. The scales for the 
curvilinear co-ordinate axes u, v, w at any point are in general different 
from this scale of length, and are moreover a function of the position of 
the point in space. In other words, the magnitudes of the increments 
du, dv, dw as measured in the Cartesian co-ordinate system are 

ds,£ du 

dsv = Cv dv [220] 

dSw dw 

in which ««> are factors accounting for the differences in the scales 

for the M, V, and w co-ordinate axes at the point in question and the scale 
of length of the Cartesian system. 

A given vector increment of length ds is expressed in the Cartesian 
co-ordinate system by 

ds = idx j dy k dz [221] 

and in the orthogonal curvilinear system by 


ds — j'u ds,^ I t'v dsv d” i'w dSw 


[222] 
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The length of the vector increment ds in terms of the Cartesian co¬ 
ordinates is determined by 

{dsY = {dxY + {dyY + {dzY [223] 

whereas in terms of the curvilinear co-ordinates 

{dsY = {dsuY + {ds,Y + (ds^Y [224] 

or 

{dsY = eY(duY + eY{dvY + eJ^{dwY [225] 

it being understood that this length is measured by the scale of the 
Cartesian system. 

The scale factors ^wy which in general are functions of the position 
of the point in question, that is, functions of x, y, z or w, w, may for 
given curvilinear co-ordinate system be found in several ways. In simple 
cases the expressions for dsuy dsy, and ds^ may be written down by 
inspection; whence the scale factors according to Eqs. 220 become 
evident. A more formal method of determining them follows. 

For any particular curvilinear co-ordinate system, the co-ordinates 
X, y, z are expressible as functions of «, v, w, thus 

x=fiiu,v,w) [226] 

y=f 2 (u,v,w) [227] 

z=fz{,u,v,w) [228] 

According to the rules of the differential calculus, 

~ du — dv + ~ dw ^ dx 

du dv dw 

^du + ~ dv + ^ dw = dy [229] 

du dv dw L j 

— du + — dv + —dw — dz 

du dv dw 


or 


dSu 




dSu + ^ dsv + ~ ds„ 


dx 


dSu 


dSu ~~~ dSv "I" ~~ dsy, = dy 

dSy dSy) 


dSn “T ds 0 ”1“ dSy 

dSu dSff 


dz 


[230] 
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In terms of the transformation matrices 


J = 


237 


and 





du 

dv 

dw 

df2 

dj2 

^/2 

du 

dv 

dw 


dfa 


^dU 

dv 

dw_ 



Mi 

dSu 

ds„ 

ds ID 




dSu 

ds. 

dSy; 



gs 

_dSu 

dSv 



[231] 



^du 


dx 

7 

dv 


dy 


jdw_ 


_dz_ 




the relations 229 and 230 may be written in the matrix form 


and 


From Eqs. 220, it is clear that 


and hence that 


[232] 



~dsu~ 



7. 

ds„ 

= 

dy 


^ds 


jiz^ 


~dsu~ 



0 0“ 


du 

dsv 

= 

0 

0 

X 

dv 

^ds 


_0 

0 


jdw_ 


7 = 7. 


0 

0 


0 

€<0 

0 


0 

0 


[233] 


[234] 


[235] 


[236] 


Since both the Cartesian system and the curvilinear system are 
orthogonal, it follows (see Art. 4, Ch. Ill) that the matrix 7. in the 
transformation 234 is orthogonal, and hence that 

(?.)« = 7.-^ 


[237] 
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the subscript t denoting the transposed matrix. But from Eq. 236 




c„ 0 0 

0 Cv 0 
0 0 Cw 


(y.)< 


[238] 


and with Eqs. 236 and 237 this gives 


= 


u"* 0 

ev^ 
0 


0 

0 


0 

0 

2 

Cw J 


[239] 


Hence, by means of Eq. 231 it follows that 


, 2 ^ . /^Y + 

“ \du/ \du/ \du/ 

[240] 

. 2 ^ 

^ \dZ>/ \dV/ \dv/ 

[241] 

ej = (^JlY + f + /"^Y 

^ \dw/ \dw/ \dw/ 

[242] 


from which the scale factors are determined. 

As an illustration, the cylindrical co-ordinates 
may be considered, for which the z-axis is chosen 
coincident with the axis of cylindrical s)Tnmetry 
^ (Fig. 18). The relations 226, 227, and 228 then 
read 


r .\P 


X = r COS <l> 
y = r sin <f> 
z = z 


[243] 

[244] 

[245] 


Fig. 18. Cylindrical co¬ 
ordinates with the 2-axis 
as axis of cylindrical 
symmetry. 

The variables r, <j>, z are chosen to correspond 
respectively to u, v, w. Then Eqs. 240, 241, and 242 yield 

[246] 

[247] 

[248] 

Hence 


Cr® = cos^ <t> -H sin^ -f 0 = 1 

sin^ <l> + cos^ ^ -f 0 = 
c,2 = 0 -I- 0 -t- 1 = 1 


Br = 1, - r, e* = 1 [249] 

are the scale factors for this case. The vector increment of length is 

ds = ir dr -b i^r d<t> + dz [250] 
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that is, 

dSr = dr, ds^ = rd 4 >, ds^ = dz 

[251] 

and 

(ds)® = (dr)® -h r®(d«)® -1- (dz)® 

[252] 

In this simple example, the last three results can, of course, be written 
down at once from inspection of Fig. 18. 


X 



Fig. 19. Spherical polar coordinates. 


The geometrical relations between spherical polar and rectangular 
co-ordinates are illustrated in Fig. 19. Accordingly, Eqs. 226, 227, and 


228 become 

X — f sin cos <t> [253] 

y = r sin sin 0 [254] 

z = r cos $ [255] 

The variables r, 6 , are chosen to correspond respectively to «, v, w. 
Then Eqs. 240, 241, and 242 yield 

— sin^ $ cos^ <l> sin^ d sin® <t) -f cos® (7 = 1 [256] 

C® = r® cos® d cos® -t- r® cos® O sin® 4 > sin® = r® [257] 


c^® = f® sin® e sin® <l> + sin® 6 cos® ^ -f 0 = r® sin® $ [258] 

Hence 

Cr = 1, e$ = r, — r sin B [259] 
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are the scale factors. The vector increment of length is* 
6 s = if dr A-i«r dd At iifX B d4t 


that is, 
and 


dSf = drf ds0 — rdd ds^ = r sin 0 

{dsY = {drY + r^ideY + r® sin^d (d^)2 


[260] 

[261] 

[262] 


The most commonly used vector operations are the gradient, diver¬ 
gence, curl, and div grad, or Formulation of these in terms of any 
orthogonal curvilinear co-ordinates «, », w and specifically for the cylin¬ 
drical and spherical polar co-ordinates are discussed in turn. 

The expression for the gradient of a scalar function U reads 


ATT . dU dU dU 

grad U = tu- -h — 

dSn oSf) 


[263] 


or 


, „ . 1 dU ^ . I au ^ , 1 dU 

grad U = ^ 

Cu du Cy dv €y, dw 


[264] 


With the help of Eqs. 249, this becomes, for cylindrical co-ordinates. 


ATT .du^.xau^.au 


[265] 


and for spherical polar co-ordinales, substitution from Eqs. 259 gives 

1 au 


,,, . au . lau 

grad U = tr—+ tt-—+ 

dr r ao r sin 6 d<i> 


[266] 


For the formulation of the general expression for the divergence of a 
vector function A, the definition given by Eq. 56 is applied to a curvi¬ 
linear parallelepiped (Fig. 20) enclosed by the surfaces u = constant, and 
u du = constant; v = constant, and v dv = constant; w = con¬ 
stant, and w + dw = constant. Except for differentials of higher order, 
the elementary areas of opposite faces of this parallelepiped are equal. 
Specifically, the elementary areas of the faces normal to iu, *», iw are 
given respectively by 

da,i dsp dsyf —— dv dw [267] 

da„ —— dSy, dSn —— dw du [263] 

do„ = dsu dsv = CuCv du dv [269] 

*In this example, one may also write down the expression for ds directly and thus obtain 
the scale factors without applying the formal method. 
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The volume of the parallelepiped is 

dV = dsu dsv dSy, = du dv dw 


The surface integral of A is given by 



* da ““ u-f-du ^ ti dcL%i^ u “1“ ^A y dctyj t>-}-< 2 v dcty^ p 


[270] 


[271] 


lo-corve 



Fig. 20. A curvilinear parallelepiped formed by surfaces of constant «, v, and w. 

in which .A Ay, Ay, are the components of A in the directions of *», C 
respectively, and the subscripts indicate that the quantity enclosed by 
the brackets is to be evaluated at the points u + du, v, w, u, v, w; u, 
V + dv, w; u, V, w, etc. Now 

[Au dau]u+du = [^u da„]„ + — [Au da„]„dM [272] 


so that 


[yl u dflu] p^du \A p dG„] p 


— [A p doplpdu 
du 


du 


[A uCfCju dw dv dw 


[273] 


and so forth. Hence 



• da = 


d S d ] 

~ (-4 iv') “f" {.A. V^wCu) -}- ~ (-4 w^U^ v) I 

dti dv dw J 


[274] 
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SO that the general expression for the divergence becomes 


div A == 


J> A • da 

dsn dSfff 

1 {d . 


“f” (^A^nfCu) “I" - [275j 

CuCvCw dv aw J 

In cylindrical co-ordinates^ this reads 

div^=l{|;M-r)+^M,)+g(A,f)) CZ 76 ] 


div ^ - (fAr) + 1 Mi + Ml 

rdr^ ' r d4> dz 


In spherical polar co-ordinates, 




div^ =i|-(r2^,) + —^ [279] 

r^ dr ^ ' r sm 6 de r sin B d<t> ^ ^ 

The expressions for the components of the curl of the vector function 
A are obtained through applying the defining relation 89 to elementary 
curvilinear rectangles lying in planes normal to the directions of ivy 
and iyj. Except for differentials of higher order, the opposite sides of such 
a rectangle are equal. Considering the ^-component, the sides of the 
rectangle are ds^ = Cv dv and ds^ = dw. The line integral of A taken 
around this rectangle is expressed by 

^A • ds ~ \jA y) ds vj XU “f” XD V-\-dV V dSxu\v 


ri4 ID dSxi^X)^dv E"^ IP dSyj^X) “f“ - E"^ dSxjo\x) dv 

dv 


\,Ax) dS'^xD^v) — lAu ds^xff - \_Av dsjti; dw 

aw 


E282] 
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so that Eq. 280 becomes 


J r* 0 d 

M • ds = — ds dw 
u dv dw 


• ds = iAy,ey,)v ~ iAvev)Jtdvdw 
u dw I 

The enclosed area is ddu = e^Cw dv dw. Hence by Eq. 89, 


and similarly 


1 f ^ d 

curl^ A = I™" {AidCjju^ "7 

CvCw ow 


\ { d d 

curl„^ =-1— {A„eu) - — (Ay,e^) 


curli» A = 


CuCv [dw 




In cylindrical co-ordinates, these expressions become 

- . 1 dA z dA 0 

curb A = - - 

r d<t> dz 


curl^ A 


dAr dAz 
dz dr 


curl,^=i^M,)-l^ [290] 

and in spherical polar co-ordinates, they read 

P92] 

a.rl.^=ll(M,)-l^ [293] 

The evaluation of V'^U is obtained through substituting the components 
of grad U from Eq. 264 for the components of A in Eq. 275. This gives 

y2jj _ ^ |~^_j_ .1_ — f r294] 

e„c*eu,ldM\ du/ dv\ dv) dw\ey, dw)\ ^ 
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For cylindrical co-ordinates, this yields 


V^U 


rdr\ dr/ 


+ 


1 d'^U d^U 


d^‘ 


+ 


dz^ 


In spherical polar co-ordinates, 

1 d 




r^dr\ dr/ 


+ 


sin 6 dd 


( 


. dCA 1 d^u 
dd)'^ r^sin^e dp^ 


[295] 


[296] 


The first term on the right-hand side of this equation may be written in 
other forms by noting that 

1 d / 2 dU\ _-d^U 2dU d^jrU) 

r^dr\ dr / ~ dr^ r dr ~ r dr^ 



PROBLEMS 

1 . Let A, B, C he three vectors extending from a fixed point, O, to the points 

a, h, Cj respectively. Express the directed segments ab and ac in terms of Ay B, C. If b 
lies on the line ac and divides it in the ratio 

ab 

— — m 
ac 

write the expression for B in terms*.of Ay C, and m. Conversely, if B = tnA -f »C, 
where m and n are scalars such that w -f w = 1 , show that b must lie on ac and find the 
ratio 

ab 

ac 

2. Let Ay B, C, D be four vectors extending from a fixed point O to the points 
a, by c, d, respectively. As in Prob. 1 , show that the necessary and sufficient conditions 
yielding a, by c, d coplanar are expressed by the relations 

a 4- +7 = 1 

D = aA -f' PB yC 


in which a, /3, 7 are scalars. 

3. The vectors from the origin to the points a, c, d are 

A = f +y + ^ 

B — 12 -{-j3 
C — i3 +j5 — k2 
D ^ —j A- k 

Express the vectors ab, hCy cdy da in terms of the unit vectors f, 7 , k. Show that ab and 
cd are parallel. 
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4. Prove that the absolute value or length of a vector A is given by 

A - \/A- A 


Find the lengths of the vectors A, and D in Prob. 3. 

5. Evaluate the following scalar products: 

(i) 

(ii) {i +j2 - ^3) • (i4 + k2) 

(iii) (fSO + ^35) • (-f3 -j\1 + kl) 

6. Verify Eq. 3, page 188, for the case where 

A = i2 4- >3 - k 
i -f kZ 

C ^ i - j2 
D = —i2 + j kZ 

7. Find the cosine of the angle between the vectors 

A = i - j2 k2 
B = 12 +i - kl 

8. The sides of a triangle are vectors A , B, and C, of length a, and c, respectively, 
such that 

.4 = J5 - C 

By using scalar multiplication, square both sides of this equation and, by interpreting 
the result geometricaUy, obtain the law of cosines. 

9. If A and B are nonzero vectors, show that the necessary and sufficient condition 
for A and B to be: 

(i) parallel is .4 B = 0 


(ii) perpendicular is .4 • B =0 

10. Evaluate the following vector products: 

(i) (/2 +i2 - k) X a +y) 

(ii) (t5 -j -f ^) '^ (i2 + k2) 

(iii) {i -f-y 4- ^ {i A-j A- kl) 

11. If A and B are sides of a triangle, show' that the area of the triangle is given by 

area =* \V{A^B) ■ {A^B) 

Calculate the area when 


A =i -\-j -Vk 
1? - »• 2 + k?> 


12, Prove Lagrange’s identity 

(.4x5). (CxZ?) 


{A-O 

{B-O 


{A-D) 

(BD) 


Use this to find an alternative form for the area formula given in Prob. 11. 
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13. Using the vectors given in Prob. 10 (iii), compute Vx, Vy, F*, and the projec¬ 
tions of Eq. 14, page 191. Find the angles Oyx, dzxj Bxyt and in terms of 

these results verify Eqs. 16, 17, and 18, page 191. 

14. If A ^ By C are coterminous edges of a tetrahedron, show that the volume of the 
tetrahedron is given by 

volume = ^1^ X C| 

Calculate the volume when 

A ^iS^j + k 

J5=f+i + ife 

15. Show that 

{AyB)y(C^D) = (A^B-D)C - (AxB-C)D 
= (A>cC-D)B - (BxC-D)A 

16. Prove the formula 

(A^B)- (B^O^iC^A) ^ (AxB-C)^ 

17. If U = + 4y^ -f 162 ^, find grad U at the point P(2,2,l). What is the shape 

of the constant value surface through P? Find the directional derivative of Z7, 

ds 

at P, if the direction of 5 at P is along the vector 

A = —* + + jK2 

18. Verify Eq. 48, page 198, if 

u + 

V = xyz 

19. Find a function U (x,y,z) with gradient equal to 

grad U = i2x -tj5y^ + k4z^ 

20. In fluid dynamics, there arises the energy function 

<f>(x,y^) = r ^ 
t/po P 


where the density of the fluid p(a:,y,z) is a function of the pressure />(:c,y, 2 ). Find the 
general expression for 

grad<^ 


If in particular 


p = {x^ + z^) - i 


and 


p = cp iCy a constant) 
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21. Let V 


grad^ 


1 ix -\-jy 4- kz 
c (x* -f + 2*) 


^2 ^ 4 y 2 ^ 15^2 define a potential. Calculate the line integral 
y grad r; • ds 


from Pi(l,1,1) toP2(2,2,2): 


(i) By integrating along straight lines from (1,1,1) to (2,1,1) to (2,2,1) to (2,2,2). 

(ii) By integrating along the straight line P 1 P 2 . 


22. Calculate the divergence of the following vector fields at the points indicated. 
Which of the points represent sources? Sinks? 

(i) A = - y2) -f j(z2 - x^) + k{y^ - z^) at (2,3,1) 

(ii) A = {ix + kz){x^ 4* y* + at (-1,2,2) 

(iii) A = (t3z — ySjc -f kSy){xy) at (1,0,0) 

23. By considering the defining equation 56, page 201, calculate div {ix -\’jy-\- kz) 
at the origin, using a sphere of radius Ar, with center at the origin, as the infinitesimal 
volume. 

24. Determine the volume of fluid per second flowing out of a spherical region of 
radius 3 feet if the vector velocity field for the region is given by 

V = ix^ -f jy^ + kz^ feet per second 

referred to a set of axes with origin at the center of the sphere. 

25. Calculate the volume of fluid per second flowing into a cube measuring two 
feet along each edge if the vector velocity field is given by 

V * —ix^y^ -^jyh -{- kz^x feet per second 


referred to a set of axes with origin at the center of the cube and such that the x-, y- 
and z-axes are p)erpendicular to a face of the cube. 

26. Show that the volume enclosed by a closed surfatce 5 is 

volume * i jrv(r*)-da 


where r is the distance from the origin to the variable point; that is, 
r = -h y^ + 2 *. 

27. Find the potential U{x,y,z) associated with a vector force field which is 
directed toward the origin, with magnitude inversely proportional to the distance 
from the origin. {Hint: By symmetry, U will be a function only of r, the distance from 
the origin.) 

28. The velocity of a fluid is radially outward from a point source and is propor¬ 
tional to the distance from the source. Find the velocity potential associated with this 
vector velocity field. 

29. A sphere of radius a with center at the origin contains a space charge of density 

p ^ ^ (where r *= y/ x^ 4- y® 4- 2 ^) 


There are no charges exterior to the sphere so that the resulting field will possess 
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spherical symmetry, that is, 

A = f(r)T (where r =* ix -i-jy + kz) 

Using Eq. 64, page 205, on a sphere of radius r, evaluate f(r) and thus show that 
A = Tz —3 T (when r > a) 


and 



(when r < a) 


30. In the preceding problem the potential U associated with the field A may be 
computed from 


r oo 

^•dr 


(This may be thought of as the work done by the field when a unit charge, upon which 
it acts, moves from r out to infinity.) Calculate the expression for U valid outside the 
sphere and show that U satisfies 

VW = 0 


Also find the potential U valid for points inside the sphere and show that here U 
satisfies 

= -4wp 

31. On the surface of a sphere of radius a and center at the origin is a surface 
charge of constant density <r. By the same procedure used in Probs. 29 and 30, de¬ 
termine the vector field A , and the scalar potential U, for points interior and exterior 
to the sphere. Show that Laplace’s equation is satisfied for all points except on the 
surface of the sphere, and that on the surface itself, Eq. 68, page 206, is satisfied. 

32. Calculate the curl of each of the following vector fields: 

(i) A == -iy +jx 

(ii) A - i3xy -\-j2yx + kyz 

(iii) A = ixyz A- jix'^ 4- 4- 4- k{x 4 - y 4“ 2 ) 


33. Verify Stokes’s theorem by computing separately 

^ A • ds 

and 

r 

(curl A) • da 


X' 


in the case where 


A iy - jx 


and the surface S is the hemisphere of radius A, above the 3cy-plane, whose boundary 
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L is the cirde 

in the *y-plane. 

34. Evaluate 


X* + 


/ 


A • ds 


around a square of side h, which has a comer at the origin, one side on the x-axis, and 
one side on the >^-axis, if 

A — i(x^ — y^) + j2xy 

35. Consider an infinitely long, straight vortex thread of constant moment /. By 
using Eqs. 102 and 103, page 213, together with the fact that the resulting field will 
possess cylindrical symmetry (that is, the lines of force will be circles about the vortex), 
deduce the expression for the vector field A. Use cylindrical co-ordinates with the 
2 -axis along the vortex. 

Show that the potential U which satisfies Eq. 130, page 220, is given by 

U = 2I(do - d) 

where 6 is the angle in cylindrical co-ordinates. Verify that this is a multivalued 
potential function which satisfies Eq. 136, page 222. 

36. Consider an infinitely long right circular cylinder of radius h whose axis is the 
2 -axis of cylindrical co-ordinates. Interior to the cylinder is a vortex density J defined 
as follows; the direction of J is always parallel to the 2 -axis and the magnitude is 
given by 

1/1 

The exterior of the cylinder is assumed to be vortex-free. Using the same sort of 
reasoning as in the preceding problem, determine the vector field ^4, obtaining ex¬ 
pressions valid inside and outside the cylinder. For the inside of the cylinder, find the 
vector potential F which satisfies 

curl P - A 
div P = 0 


(Hint: From Eqs. 126 and 127, page 219, it can be seen that the direction of P is the 
same as that of /.) 

For the outside of the cylinder, find the scalar potential U which satisfies 

grad U = —A 


37. A point P(x,y,z) moves along a space curve in such a way that its co-ordinates 
are given by the following functions of time: 

X ^ a cos t 

y ^ a sin t 

z ^ bi 


Find the vector velocity and acceleration of the point P, 



250 


VECTOR ANALYSIS 


[Ch, V 


38. The potential energy of the region in the preceding problem is given by 

U = —; sm t 

Find dU/dt for the point P{x,y,z) of Prob. 37, at time t. 

39. With reference to Probs. 37 and 38, let X = — grad U, Determine for 
the same P{x;y,z) at time /. 

40. Let 

£; = H1±^ 

z 

A = i{x^ + yz) -f-y(y* + zx) + + xy) 

B = i{xy) -f-i(yz) + k{zx) 

Calculate: 

(i) grad U 

(ii) divyl,div5 

(iii) curM,curlJ5 

(iv) div {UA) 

(v) curl {UA) 

(vi) div {A ^B) 

(vii) curl {A B) 

(viii) grad {A * B) 

41. If is a constant vector, prove 

V{A ’I) ^ A 

42. Let Vi and F 2 be vectors from the fixed points (xi,yi, 2 i), (x 2 ,y 2 , 22 ) to the 
variable point {Xyy,z). Show that 

(i) div (Vi X F 2 ) = 0 

(ii) curl (F, X F 2 ) = 2(Fi - F 2 ) 

(iii) grad(Fi*F 2 ) = Fi + F* 

43. If .4 is an arbitrary vector field, evaluate 

(A^V)-R 

and 

(^xV)xie 

44. Obtain Eq. 287, page 243, directly from 




dz^ 


by the substitution given by Eqs. 235 to 237, page 237. 

45. Obtain Eq. 288, page 243, directly as in Prob. 44 by means of the substitution 
given by Eqs. 245 to 247, page 238. 
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46. Suppose that 

^ = ^(«i) 
OL\ = ^i(a2) 
OC2 = ^2(a3) 


Q!„ = 

a series of relations through which ^ is expressed as a function of «, v, w. Show that 

daida2 dan~i, 

daida2da3 da„ 


grad^ = 


Vofn 


47. Apply the formula of the preceding problem to compute the gradient of 


in which 


tP =lnsine“*“**^^‘^> 

A = iuCti + iv(i2 + iwO’S 


B == iuU + iyV + iwW 


the quantities ai, 02 , being constants. 

48. Consider a rectangular co-ordinate system with origin at the point 0 and let 
Q and P be two other points separated from O by the distances p and R respectively. 
Let r denote the vector distance from ^ to P (as defined in Art. 17) and similarly let 
p and R denote the vectors OQ and OP. The angle between the latter two vectors is 

If Q is assumed fixed while P moves upon the surface of a sphere with radius P, 
compute the magnitude and the direction cosines of the vector grad^ cos \p. Show that 
this vector is perpendicular to R. 

49. With reference to the previous problem compute the magnitude and direction 
cosines of the vector grad<? cos ip when P is fixed and Q moves over the surface of a 
sphere of radius p. Which vector, p or R, is perpendicular to gradg cos \p ? 

so. If <p{r) is some scalar function of the distance r as defined in Prob. 48, show that 


gradp<^ = ^gradpr 


- grader 


Compute the magnitude and the direction cosines of this vector if 
4 > = -y- {k being a constant) 


51. 

52. 
and 


Referring to the statement of the previous problem, show that 
VqV = VpV == - 

If a is a constant vector and <^(r) a scalar function of r, show that 
Vg X (ai^) == a X Vp</> 


Vg X Vg X (a^) = Vg(a • Vg<#>) — aVg<p 
53. Prove the vector identity 


£a--^[.4x£x^ + {E-A)Al 
A • A 


in which E and A are any vectors. 
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54. Prove the following vector relations: 

E- (V X V X a^) = k^<l>E • a + •£ • V(a • V^) 

£-V(a-V0 ) = V-[(a-V<^)£] - (a-V<^)(V-£) 

£-(VxVxa0 ) = {k^<l)E - (V ■ E)V<t>\ + V • [(a • V(^)E] 

in which £ is a vector function of x, y, z, <t> is the scalar function defined in Prob. 50, 
and a is a constant vector. 

55. If A and B are any two vector functions of the space co-ordinates, show by 
means of Gauss’s law that 

J^(£-VxVx.4 - ^ . VxVx£)rf» = xVx£ -BxVx^].da 

in which da is a vector element of the surface S and dv is an element of the enclosed 
volume V. 
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Functions of a Complex Variable 

It is assumed that the reader has some acquaintance with the subject 
of complex numbers and the representation of them in the complex plane 
(also known as the Gaussian plane). Here it is customary to consider the 
x-axis as the “ axis of reals and the y-axis as the “ axis of imaginaries/^ 
The symboly = \/—1 prefixed to a real number signifies that the latter 
is the imaginary or y-component of a given complex number. The y-axis 
is, therefore, sometimes referred to as the “y-axis.’’ 

A complex number z — x + jy is plotted in the complex plane as the 
point P{x,y), and z is interpreted geometrically as a vector* drawn from 
the origin to this point. This interpretive procedure is referred to as the 
rectangular representation of the complex number (or vector) z. Its 
polar representation is given by 2 = pe^^, whence p = Vx^ + y^, and 8 = 
tan“"^ {y/x). The familiar law of parallelogram addition applies to the 
addition of any given set of complex numbers. The details of this process 
as well as those involved in the multiplication and division of complex 
numbers are not further elaborated upon here. 

The object of the discussion in these pages is rather to give the reader 
some acquaintance with a complex function whose independent variable 
is a complex number. The most obvious novelty exhibited by the function 
of a complex variable, contrasted with a real function of a real variable, 
lies in the fact that the values of both the function and the variable 
are no longer characterized by single numbers; two numbers are now 
required for the specification of each. Thus a value of the variable 2 in¬ 
volves the specification of the two quantities x and y, and since the 
function of 2 is likewise complex, its values also involve the specification 
of a real and an imaginary part. 

In view of this situation it is clear that the process of graphical rep¬ 
resentation requires new methods in the case of complex functions. In 
addition, one should carefully review the fundamental operations of 
the differential and integral calculus in order to see whether their familiar 
interpretation may be extended in some way to apply to complex func¬ 
tions. This extension should be made w^ith the minimum p)ossible change 
in basic conceptions in order that the many useful relations known with 

■"Complex numbers are frequently referred to by electrical engineers as vectors. It has 
been pointed out that the term “ vectors is in this connection misused and that such misuse 
may le«ad one to draw false conclusions or otherwise fall into dangerous byways of thought. 
This view is not shared in this book, ijrincipally because the discussion given in Art. 5 shows 
that it has little justification. 
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regard to functions of a real variable may become available also to the 
manipulation of the complex ones* 

The most useful operations familiar to the reader in connection with 
functions of a real variable are those of differentiation, integration, and 
expansion in series. A discussion of the extension of these conceptions to 
functions of a complex variable is the principal aim of the following 
articles. 

In these discussions no particular attempt is made to give rigorous 
proofs. The derivations are given entirely for the purpose of providing 
the reader with a partial insight into the relevant fundamental inter¬ 
relationships. Wherever possible, an attempt is made to establish contact 
between the new conceptions and those with which the student has an 
acquaintance of longer standing. To the engineer who is trying to gain a 
working knowledge of function theory, rigorous proofs are a waste of 
effort, but plausibility arguments do serve a useful purpose in that they 
provide the necessary circumspection for facile and intelligent use of this 
important mathematical tool, and at the same time lay the groundwork 
for a more thorough study which may seem desirable at a later time. 

1. Differentiation 


The complex function of a complex variable z is denoted by 



w = /(z) 

[1] 

with 


z = » +jy 

[2] 

and 


w = u jv 

[3] 

Therefore 

u and V are functions of both x and y; thus 



u = u{x,y), V = v{x,y) 

W 


It should be observed that both the real and imaginary parts u and v 
are real functions of the two real independent variables x and y, which 
are the real and imaginary parts of the complex variable 2 . The language 
used here may be somewhat confusing to the reader, inasmuch as v and y 

*This approach to the consideration of the theory of functions of a complex variable may 
appear to some readers to be somewhat strange. It should be remembered, however, that 
these pages are addressed primarily to the engineering student whose previous experience 
with mathematics has been confined almost wholly to real functions of a real variable. To him 
the process of regarding the present discussions as an extension of some of the manipulations 
which apply to functions of a real variable not only appears to be sensible but also is the 
course which his process of learning will take in any case. 
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are spoken of as the imaginary ” parts of w and z respectively, whereas 
at the same time they are pointed out as being real quantities. The 
strangeness of this method of expression should, however, readily be 
overcome by concentration upon its mathematical significance as ex¬ 
pressed by the relations 1 to 4. 

It is now of interest to examine whether the derivative of the function 
w with respect to the variable z may be interpreted as the limit of the 
ratio l^wlAz, in which Aw and Az represent corresponding increments, as 
the increment Az approaches zero. Reflecting upon this situation at once 
discloses an apparent difficulty, since one is reminded of the fact that 

Az = Ax + j Ay [5] 

and hence that Az may be interpreted in an infinity of ways. If one 
assumes for the moment that the increment Az has a fixed magnitude, 
its direction in the complex plane may be varied in an infinite number of 
ways, thus yielding an infinite number of corresponding increments Aw 
in the function. It does not necessarily follow, of course, that the ratio 
Aw/Az correspx)ndingly assumes an infinite number of values, but unless, 
in the limit A 2 —> 0, this ratio is independent of the direction of Az, the 
derivative of the function w evidently does not possess a unique value. 

Whereas it is conceivable that the extension of the usual conception of a 
derivative to functions of a complex variable may require a distinction 
with regard to the direction assigned to the increment As in the complex 
plane, the simplicity and general usefulness of this derivative would 
unquestionably be greatly impaired if its value were subjected to such a 
restriction. The undesirability of the latter suggests that one ought to 
demand that the derivative operation be completely free from this 
restriction, and then inquire into the bonds which are thereby laid upon 
the nature of the complex function. If these are not so severe as to rule out 
of consideration such classes or kinds of functions as one would like to see 
embraced by the theory which is the object of this discussion, one may 
still be served by pursuing it. 

As will be seen shortly, it turns out that this point of view may well be 
taken and, surprisingly enough, that more functions out of a set written 
down at random fall into a classification which meets these bonds than 
one might at the outset expect. In fact, the results are so gratifying in this 
respect that one is justified in ruling out of further consideration all 
complex functions which do not comply with this demand and in stipulat¬ 
ing that the term ‘‘ function of a complex variable ’’ shall apply only to 
those that do. 

The conditions under which the derivative of the function w with 
respect to the complex variable z may be independent of the direction in 
which the increment As is taken are readily found by first indicating the 
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derivative by means of the relations 2 and 3 as 


dw du + j dv 
dz dx + j dy 

[6] 

Now from Eq. 4 


du = — dx ■]r — dy 
dx dy 

[7] 

and 


dv = —dx + —dy 
dx dy ^ 

[8] 

Substituting into Eq. 6 and writing the result in the form 


/du . /du . dv\ dy 

dw \d:r dx) ^ \dy dy) dx 

*' 1 +j^ 

dx 

[9] 

show that the direction of the differential increment dz is determined by 
dyfdx, and hence, if the expression 9 is to be independent of this direction, 
that the necessary conditions are expressed by 

du . dv 

—h; — 
dx dx 1 

du . dv j 

— “h J — 
dy dy 

[10] 

or 


du . dv dv . du 

dy^ ^ dy dx^ ^ dx 

[11] 

Equating real and imaginary parts in this equation gives the conditions 

du dv 

dx dy 

[12] 

and 


du dv 

dy dx 

[13] 


These are the conditions which the real and imaginary parts of the com¬ 
plex function w = /(s) must fulfill in order that its derivative may have 
a unique value for any point 2 , regardless of the direction of the increment 
dz at this point. Equations 12 and 13 are known as the Cauchy-Ricmann 
partial dijjcrential equations {or condition equations). Only those functions 
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w — u + jv which satisfy these equations are henceforth to be called 
functions of a complex variable. 

Practically all the common functions familiar to the reader are found 
to satisfy the conditions 12 and 13. The simplest of these functions is 

w — z [14] 

for which 

u — X and »= y [15] 

is obviously a function of a complex variable. 

A constant times an integer power of z, namely 

w = az" [16] 

is likewise seen to satisfy Eqs. 12 and 13. Hence it follows that any 
polynomial 

w = a„z” + an-iz”"* + • • • + aiz + oo [17] 

or any quotient of polynomials 

^ anZ” + + • • • 4- fliZ 4- gp P , 

5 * 2 * + bk—i^ * + ••• + biZ + bo 

are also functions of a complex variable. The familiar trigonometric, 
hyperbolic, and exponential functions as well as the logarithm, when 
regarded as functions of z, all satisfy Eqs. 12 and 13. Fractional powers of 
z and fractional powers of polynomials in z satisfy the conditions. It is, in 
fact, more difficult to find functions that do not satisfy the conditions 12 
and 13 than it is to find those that do. A few exceptions are 

w = |z| = Vx- + [19] 

and 

w = z = X — jy [ 20 ] 

but even these simple exceptions are rather jseculiar and hardly worth 
bothering with anyway. 

It is appropriate to point out that the fulfillment of the Cauchy-Rie- 
mann equations does not suffice for the existence of the derivative. The 
latter requires that the partial derivatives 12 and 13 be continuous func¬ 
tions of X and y in the vicinity of the point in question. 

A point at which the function is not differentiable is called a singularity. 
If the function is differentiable everywhere within an arbitrarily small 
region in the vicinity of some point, it is there said to be regular or 
analytic (the term holotnorphic is also used to describe this property). A 
region throughout which a function is analytic is spoken of as a region of 
analyticity. 
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2. A GRAPHICAL representation; conformal mapping 

Since the complex function w as well as the complex variable z require 
two quantities (their real and imaginary parts) for their description, the 
graphical representation used for functions of a real variable is not 
available for the plotting of functions of a complex variable. Instead, the 
values of the variable z are plotted in one complex plane (the x,y-plane or 
2-plane), and the corresponding values of the function w are plotted in 
another complex plane (the «,i>-plane or 7:;-pIane). A given pwint in the 
2 -plane represents a complex value for the independent variable z which 
determines a value for the function w, and this value in turn determines a 
corresponding point in the t:>-p)lanc. A continuous curve in the 2 -plane may 
be thought of as defining a set of points in this plane, and if the function 
w = f{z) is continuous throughout this range of 2 -values, a corresponding 
continuous curve is thereby determined in the u'-plane. 

The construction of a family of curves throughout a given region in 
the 2 -plane makes it possible to map the behavior of the function over a 
corresponding region in the Ta-plane. For this jiuqxise the curves drawn 
in the 2 -plane may, for example, be the sets of straight lines defined by 
X = constant and y = constant, the constants being chosen so that these 
orthogonal families of lines form a uniform grid. Alternatively, a .set of 
circles concentric with the origin and the orthogonal set of radial lines 
may be drawn in the 2 -plane, or one may select any other sets of curves 
which appear best to serve the purpiose in view of the particular function 
under consideration. 

It is useful to note a very interesting property of functions of a compilex 
variable which is made evident by such a graphical representation. This 
property follows directly from the fact that the derivative of the function 
is independent of the direction of the vector increment dz in the 2 -plane. 
Assuming for the moment that the increments are finite, the derivative 
is approximated by Aw/Az. If the increment A 2 is thought of as having a 
fixed magnitude but any desired angle, the fact that the quotient Aw/Az 
has the same complex value regardless of the angle of A 2 means that 
variations in the angle of Aw are exactly equal to any assumed variations 
in the angle of Az. In other words, since the angle of the complex quotient 
Aw/Az is independent of the angle of Az, the changes in the angles of Az 
and Aw must always be equal. 

Any two increments Aj 2 and A 22 differing only in direction at a given 
point in the z-plane may be looked upxjn as a pair of path increments 
along any two curves which intersect at that pwint; and, similarly, the 
two corresponding increments AiW and A 2 W (whose magnitudes are alike 
because Aiw/AiZ = A^w/A^z) may be looked upon as a pair of path 
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increments along two curves intersecting at the corresponding point in 
the w-plane. Since the angle between the path increments Aiz and A 22 
equals the angle between the corresponding path increments AiW and 
A 2 W, any sets of curves drawn in the s-plane intersect at the same angles 
as the corresi)onding curves in the w-plane at all corresponding points. 
The process of mapping curves in the w-plane corresponding to any 
chosen curves in the z-plane, in other words, preserves the angular rela¬ 
tionships between these curves at all corresponding joints. For example, 
if two sets of curves drawn in the z-plane form orthogonal families, the 
corresponding sets of curves which are majjped in the t£»-plane by means 
of any function w =/(z) (satisfying the conditions 12 and 13, of course) 
likewise form orthogonal families. 

It should be observed that if the angle of the increment A 2 Z is larger 
(or smaller) than the angle of AjZ, the angle of A 2 TO is likewise larger 
(respectively smaller) than that of AiW. In other words, the angular 
increment between 15\W and A 2 W is equal to the angular increment between 
AiZ and A 2 Z not only in magnitude but also in sense. That is, if the rotation 
from AiZ to A23 in the z-plane is, for example, counterclockwise, the rota¬ 
tion from Aiii» to A 2 ie in the w-plane is also counterclockwise. 

If te = /(z) is a function satisfying the conditions 12 and 13, the func¬ 
tion w = /(z), in which the bar indicates the conjugate value, evidently 
does not satisfy these conditions. Since, for a given Az, the increments 
Aw and Aw have the same magnitudes but opposite angles, it is clear that 
the function w =/(z), in its mapping proj^crties, preserves the angular 
relationships in magnitude but reverses their sense (as is the case with a 
picture and its mirror image). The majiping properties of both the func¬ 
tions w =/(z) and w =/(z) are said to be isogonal (meaning that the 
magnitudes of angular relationshipis are preserved). In addition, the 
mapjiing property of the function w = /(z), which preserves the sense as 
well as the magnitude of angular relationships, is described as being 
conformal. 

As a consequence of the property of conformality, one may see that if a 
small region of a map in the z-plane (with numerous intersecting curves) 
is compared with the corresponding small region in the w-plane (with 
numerous corresponding intersecting curves), these two small mapp>ed 
regions are found to be exact replicas of each other except for a factor of 
magnification (or diminution) equal to the magnitude of Aw/Az at the 
point where this region is located, and a rotation through the angle of 
Aw/Az. This observation is strictly accurate, of course, only in the limit 
as the size of the entire region tends to zero, but for small regions of finite 
size, the two corresjwnding maps are very nearly alike in detailed form. 
The term “ conformal ” is thus seen to assume a clearer significance. 
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3. The inverse function 

The corresponding maps in the w- and s-planes for a given function 
^ =/(2) place in evidence a mutual relationship between the two com¬ 
plex quantities w and z in the sense that either one may apparently be 
looked upon as the independent variable. In other words, the given 
function 

w =fiz) = u(x,y) +jvix,y) [21] 

may presumably be inverted to yield 

z = <^(w) = x{u,v) jy{u,v) [22] 

at least over regions throughout which a one-to-one relationship exists 
between w and s. This thought may be investigated further through the 
consideration of the relations 

- dX . , dX , 

dx = — du - dv [23] 

du dv 


dy = ^ du -\-—dv [24] 

du dv 

which are the inverse of Eqs. 7 and 8. 

Denoting the determinant of Eqs. 7 and 8 by D, and noting Eqs. 12 
and 13, one sees that 


du dv du dv 
dx dy dy dx 


/ du^ / du^ / dv^ / dv^ 
\dx) ^ V^y/ ^ \^y/ 


But, again with the help of Eqs. 12 and 13, one has* 


/•/ / \ 


du .du dv . dv 
dx ^ dy dy^^ dx 


so that Eq. 25 yields 




Now Eqs. 7 and 8, on the one hand, and the pair of inverse Eqs. 23 
and 24, on the other, must have inverse matrices; that is. 


dx dx 
du dv 
dy dy 
du dv 


du du 
dx dy 
dv dv 
dx dy 


*The correctness of these relations should be clear from the fact that the value of the 
derivative is independent of the angle of the increment dz — dx + j dy. If this angle is zero 
then dy = 0, which means that u and v are differentiated partially with respect to x only. 
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from which it follows that 


Hence 


bx 

1 bv 

dx 

1 du 

Tool 

bu 

D by^ 

dv 

Ddy 


by 

1 bv 

^ _ 

1 du 


bu 

D bx 

dv 

D dx 



bx 

bu 

yy 

bv 


[31] 


bx 

bv 

bu 


[32] 


which are the Cauchy-Riemann equations pertaining to the inverse 
function 22. 

With the help of these various relations, one may now write 


dz 

dw 


_ Bx . dy 
~ du dll 


dv . Sv 
dy ^ bx 

7 ) 


1 


bv . bv 
by bx 


1 _ ^ /djvy^ 

bll . bv f{z) \dz) 

Vx'^^Vx 


[33] 


According to Eqs. 31 and 32, the inverse function 22 is also a function 
of a coinj)lex variable, and Eq. 33 shows that tlie derivative of the inverse 
function is the reciprocal of that for the given function at corresponding 
values of w and s. In other words, the conformal maps for the function 
w = f(z) may likewise be regarded as the maps for the inverse function 
z = 

A precautionary remark may be made here about difficulties of inter¬ 
pretation in dealing with multivalued functions. Although these matters 
are discussed in greater detail in subsequent articles it should be observed 
now that, in view of Eq. 33, the derivative of the inverse function evi¬ 
dently does not exist at a ix)int where that of the given function w — f{z) 
becomes zero. In the immediate vicinity of such points, the maps in the 
w- and s-planes for a given function are still uniquely related, although the 
preservation of angular relationships no longer holds (as is further dis¬ 
cussed in Art. 14). 
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4. The s-plane and its associated complex sphere ; the point 

AT INFINITY 

At various times it is expedient to consider the value or behavior of a 
function at infinity, that is, in the limit s oo. Since any point in the 
complex s-plane which is infinitely remote from the origin is a point at 
infinity, it may seem as though infinity should be regarded as a vast 
region embracing, an infinity of points. While admissible on purely logical 
grounds, this view is extremely awkw'ard from a mathematical standpoint, 
since the behavior of a function ‘^at infinity’’ would embrace its behavior 
at an infinite number of points. 

The difficulty involved here is readily overcome, however, through 
introducing (by definition) a slightly altered conception of the complex 
plane. Thus it is perfectly admissible to think of this plane as being the 
surface of a sphere of infinite radius, or, for the sake of easing the mental 
strain produced by this conception, as a sphere with so large a radius that 
any finite region that may be considered appears for all practical purposes 
to be flat. If the origin of this ‘‘ plane ” is taken to be the south pole of 
the sphere, all points infinitely remote from the origin coincide at the north 
pole. Infinity is then no longer a vast region but becomes a single point. 
It is called the point at infinity. 

In order to overcome the necessity of thinking of the s-plane as an 
enormous spherical surface, another artifice may be utilized which in some 
respects has certain advantages over the infinite sphere idea. The 2 -plane is 
visualized as a truly flat surface, with a sphere of arbitrary but finite 
radius resting upon its origin. The point of tangency between the sphere 
and the 2 -plane at its origin may be taken as the south pole of the sphere. 
The corresponding north pole is then perpendicularly above the origin. 

A given finite point Zq in the s-plane is now thought of as joined with the 
north pole of the sphere by a straight line, which intersects the surface of 
the sphere at one point other than the north pole. This geometrical con¬ 
struction, w^hich is called stereographic projection^ associates a point on 
the sphere with every point in the complex z-plane in a manner unique 
for all points except those infinitely remote from the origin. All these 
correspond to the north pole of the sphere. Thus, with the help of stereo¬ 
graphic projection, infinity is again interpreted as a single point. 

In all considerations regarding regions and paths in the complex plane, 
the corresponding ones on the surface of the sphere may be substituted. 
It can be shown geometrically that the process of stereograph!c pro¬ 
jection preserves the magnitudes of angular relationshif)s between inter¬ 
secting curves in the plane and the corresi:x)nding ones on the spherical 
surface (the process is isogonal). Circles in the plane are circles on the 
sphere. In particular, any circle on the sphere which passes through the 
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north pole becomes a straight line (circle with infinite radius) in the 
plane. A great circle through the north pole (meridian) corresponds to a 
straight line drawn through the origin (radius vector) in the s-plane. 

Such a sphere is referred to as the complex sphere associated with the 
2 -plane. A similar sphere may evidently be associated with the w-pldiue 
in connection with the mapping of any function w — f{z). Because of 
the isogonality of the process of stereographic projection, it follows that 
corresponding maps on the two spheres for a given function are conformal, 
so that the spherical surfaces may in all instances be used to replace the 
complex w- and 2 -planes. In this way the process of conformal mapping 
may readily be visualized over regions which include the point at infinity. 

5. ALTf:RNATIVE GRAPHICAL AND PHYSICAL INTERPRETATIONS 

A number of additional interesting properties of functions of a com¬ 
plex variable may be studied through identifying the complex plane with 
a cross-sectional plane associated with a physical system having longi¬ 
tudinal uniformity. This direction coincides with what is ordinarily 
designated as the 2 -axis of a rectangular co-ordinate system. A static 
field (electric, magnetic, or hydrodynamic) associated with such a 
supposed physical system has either a zero or a constant component in 
the longitudinal direction. This component is ignored. In the following 
discussion, and wherever the physical argument requires three-dimen¬ 
sional or space consideration, it is understood that a unit length in the 
longitudinal direction is implied. In other words, the field is regarded as 
a two-dimensional one, since its behavior is of interest only in the cross- 
sectional plane which is identified with the complex x,y-plane. 

In such a system, a vector function A (x,y) is assumed to represent 
the flow of some physical or fictitious fluid. In complex form 

A ^ Ax jA y 

With reference to Fig. 1, 5 represents a closed (mathematical) bound¬ 
ary. If a differential length of this boundary is denoted by ds, the net flow 
outward through the boundary is given by the integral 

£^nds [35] 

in which /I „ is the normal component (directed outward) of A. According 
to the geometry shown in the figure, and on the assumption that the 
integration is extended around the closed contour in the counterclock¬ 
wise direction, this integral may be written 

^Ands — jT (Ar dy — Aydx) 


[36] 
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From Gauss’s law, it is recog¬ 
nized that this net flow outward may 
alternatively be calculated by integra¬ 
ting the divergence of A over the 
surface* enclosed by the boundary S, 
that is 

^Ands — J* div A da [37] 

enclosed surface 

But 


Fig. 1. Relevant to the integral of the 
normal component of a vector function 
around a closed contour. 

and hence Eqs. 36 and 37 yield 

jT (Ax dy — Ay dx) 



enclosed surface 


11 Ax and Ay are now identified respectively with the imaginary and 
the real parts of a function of a complex variable w = J(z), thenf 

Ax = v(x,y) [40] 

Ay = u(x,y) [41] 

and the Cauchy-Riemann Eq. 13 shows that 

div A = 0 [42] 

and hence that 


^ (Axdy — Ay dx) = (vdy — u dx) = 0 


[43] 


In order that the divergence of A with components defined by Eqs. 
40 and 41 shall be zero throughout the surface enclosed by the boundary 
S, it is necessary, of course, that the Cauchy-Riemann equations hold 
throughout this region. This condition requires that the function w = 
f(z) be regular throughout the region; otherwise its derivative does not 
exist at all points over which the surface integral in Eq. 37 or Eq. 39 
extends. 

Physically, Eq. 43 means that the field A is source-free throughout 

*The reader may again be reminded that a unit of length in the longitudinal direction is 
implied so that this surface integration is actually equivalent to a volume integration. 

tit should be observed that w = Ay ■\-jAx and hence that = /(s) should not be con¬ 
fused with the vector function ^, Eq. 34. 
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the enclosed region, as evidenced by the vanishing of the divergence of A 
for all points within the region. Hence it may be said that the imaginary 
and real parts respectively of a function of a complex variable which is 
regular throughout a given region in a 2-plane may there be regarded 
as the X’ and y-components of a source-free field. 

If now the line integral of the vector function A is formed for the 
closed boundary shown in Fig. 1, with a counterclockwise direction of 
traversal, one has 

jr.4 • = jT {Ax dx + Aydy) [44] 


According to Stokes's law, it is recalled that 


i 


A ds 


J* (curl A) ■ da 

CTicloBed Burface 


[45] 


The curl of A, which is directed normal to the a;,y-plane, is given by 
what would normally be regarded as the 2 -component, that is, 

dAy dAx P/izrl 

curl, A = -— [46] 

dx dy 

Equations 44 and 45, therefore, yield 

f =/("£«-[47] 

enclofKJcl surface 

Again identifying Ax and Ay with v and u, respectively, according to 
Eqs. 40 and 41, and making use of the Cauchy-Riemann Eq. 12, one 
finds that 

curl A = 0 [48] 

If the function w = fiz) is regular throughout the region enclosed by the 
curve S, Eq. 48 holds for all points within this region, so that 

jT (Ax dx + Aydy) = jT (vdx + u dy) — 0 [49] 


Hence it may be said that the imaginary and real parts respectively of a 
function of a complex variable which is regular throughout a given region 
in the s-plane may there be regarded as the x- and y-com|X)nents of a 
field which is not only source-free but also nonturbulent. If the enclosed 
region contains points at which the derivative of the function w — f(z) 
does not exist, the relations 43 and 49 no longer hold. In view of the 
present discussion such singular points may be regarded as either sources 
or vortexes in which the origin of the field A, and hence that of the 
function w = /(a), resides. This interpretation makes it clear that unless 
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the function w has singular points somewhere in the z-plane, it must 
reduce to a constant or to zero. In other words, the singularities of a 
function are its ‘‘ life-giving ’’ elements, and out of their nature and 
distribution alone does a function derive its individual properties and 
characteristics. This view leads to a useful method of classifying functions 
purely in terms of the nature and distribution of their singularities, which 
is briefly discussed later on. 

The Cauchy-Riemann Eqs. 12 and 13 provide a further physical 
interpretation for-the real and imaginary parts of a function of a complex 
variable. Thus if Eq. 12 is differentiated partially with respect to x and 
Eq. 13 with respect to y, the subsequent addition of the two equations 
yields 


d^u d^u 
dx^ dy^ 


= 0 


[50] 


On the other hand, if Eq. 12 is differentiated partially with respect to 
y and Eq. 13 with respect to x, the subsequent subtraction of the two 
equations gives 


dh dh _ 


[51] 


These results are recognized to have the form of Laplace^s equation for 
the potential of a two-dimensional source-free field. Hence the real and 
imaginary parts of a function of a complex variable may be interpreted 
as scalar potential functions. As such they may be assumed to determine 
a pair of nonturbulent vector field functions. If these are denoted by A 
and B respectively, one may write 




and 


du 

dX 

^ du 

[52] 

dv 

dx* 

dy 

[53] 


Because of the Cauchy-Riemann equations, these field components are 
related as expressed by 

= By, Ay = -B^ [54] 


and hence the scalar product of A and B vanishes; thus 

A B A^B^ + AyBy = -A,Ay + A,Ay = 0 [55] 


In other words, the two nonturbulent fields defined by the potential 
functions u and v are orthogonal to each other.. 
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Now it is further recalled (from the study of vector analysis) that the 
system of equipotential lines defined by the equations u = constant, and 
the flow lines for field A form orthogonal families of curves. The same is 
true of the equipotential lines defined by the equations v = constant and 
the flow lines for field B. Since the flow lines for field B are orthogonal to 
those for field ^4, it follows, therefore, that the equipotential lines defined 
by w — constant are orthogonal to those defined by ^ constant. 
Hence the latter coincide with the flow lines for field A, and the former 
coincide with the flow lines for field B. This situation forms an alternative 
basis for the graphical representation of a function of a complex variable 
and for its physical interpretation. 

Thus, instead of using the conformal maps in the w- and s-planes, one 
may study a given function of a complex variable graphically by plotting, 
in the s-plane alone, the systems of mutually orthogonal cur\^es defined 
by the equations u = constant and v — constant. Throughout regions in 
which the given function w = /(s) is regular, these have the character of 
the equipotential lines and flow lines of a source-free, nonturbulent field. 
Singular points again have the character of sources or vortexes, the nature 
and distribution of which determine the properties of the given function 
w. Some aspects of these physical interpretations are discussed further in 
Art. 22. 

6. Integration; the Cauchy integral law 

A certain orientation with regard to the question of differentiation 
having been gained, attention may now be directed toward the interpreta¬ 
tion of the integral of a function of a complex variable. Here the two- 
dimensional character of the independent variable again injects some 
novel considerations at the outset. Thus if the integral 

f f{s) dz [56] 

is formally regarded as representing the integral of a given function 
w = f(z) between two particular values Zi and Z 2 of the independent 
variable z, the question of the choice to be made for the continuous 
sequence of values of 2 as it proceeds from the point Zi to the point Zo 
immediately arises. Such a continuous sequence of values evidently 
defines some path or curv^e joining the points Si and Sa in the complex 
s-plane. Since any number of paths may evidently be chosen in the 
detailed process of evaluating the integral 56, the possibility exists that 
the value of this integral may not be unique. 

This question is similar to that arising in connection with the discussion 
of the differentiation of complex functions, and it is again due to the two- 
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dimensional character of the independent variable. Again it is felt to be 
highly desirable that the value of the integral 56 should be unique, and 
if possible, that the Cauchy-Riemann equations, which insure the 
uniqueness of the derivative, should be sufficient to insure also the unique¬ 
ness of the integral 56 so that its value 
may be independent of the path of in¬ 
tegration without need for the imposi¬ 
tion of further conditions upon the 
function w. 

In order to investigate this ques¬ 
tion it is expedient to consider the 
integral formed for a closed contour 
in the s-plane, as shown in Fig. 2. 
This so-called contour integral is writ¬ 
ten 



Fig. 2. Region of analyticity in 
the discussion of Cauchy’s integral 
law. 




[57] 


Here the contour C is assumed to be traversed in the counterclockwise 
direction, whence the enclosed region G is observed to lie on the left. 
Within the region G the function tc = J(z) is assumed to be regular. For 
all points within the region G, therefore, the function is dilTerentiable, 
and the Cauchy-Riemann equations are fulfilled. 

By substitution from Eqs. 2 and ,3, the integral 57 becomes 



(m -h jv) {dx + j dy) 


= (w dx — V dy) -f j (y dx -j- u dy) [58] 


The closed contour C in Fig. 2 and the conventions regarding the direc¬ 
tion of traversal are essentially the same as those shown in Fig. 1 for 
the closed boundary 5; and since the function w = f{z) is assumed to be 
differentiable at all points within the enclosed region, the results ex¬ 
pressed by Eqs. 43 and 49 apply. Hence the important result follows that 

^/(2)d3 = 0 [59] 

Since the points z\ and Z 2 appearing in the integral 56 may be thought 
of as any two points on the contour C, as indicated in Fig. 2, it follows 
from Eq. 59 that the integral 56 is independent of the path of integration 
or that a given path joining Zi with 22 may be changed at will without 
altering the value of the integral 56 so long as the path is not moved 
across a point at which the function w is singular. The latter restriction is 
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readily appreciated through noting that if the two portions of the contour 
C joining Zi and Zg in Pig. 2 are regarde<i as two variations of a given path 
between these points, the statement that the enclosed region G contains 
no singularities is seen to be equivalent to stating that none are en¬ 
countered in the process of sweeping one of these paths across the region 
G into coincidence with the other. 

The result 59 is known as the Cawhy integral law, which states in 
effect that the integral of a function of a complex variable between two 
given jx)ints in the complex z-plane has a unique value (subject, of 
course, to the restriction that any two chosen paths enclose a region in 
which the function is regular). The nec¬ 
essary conditions to insure this result are 
expressed by the Cauchy-Riemann equa¬ 
tions which at the same time insure the 
uniqueness of the derivative of a given 
complex function. 

This result is so important for all the 
subsequent discussions that it is well to 
consider in another way the relations 
leading to it. Hgurc 3 shows a differen¬ 



tial rectangle in the s-plane with its 
center located at some [xjint z. The mid¬ 
points of the sides of this rectangle are 
denoted by a, h, c, d. A given function 


Fig. 3. An elementary closed 
path in the consideration of 
Cauchy’s integral law. 


has the value w — f{z) at the point z and is there assumed to be regular. 



Now since the function w satisfies the Cauchy-Riemann condition 
equations, its derivative is independent of the direction of the increment 
in the z-plane, so that 

dx j dy dz 


[64] 
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and hence 


/(-> = “'+If 

[65] 


[66] 

—If 

[67] 

m = . - |i# 

[68] 


The integral of the function w formed (in the counterclockwise direction) 
for the differential rectangle is given by the summation 

^/(z) dz = f{a)j dy - f{b) dx - f{c)j dy + f{d) dx [69] 



Fig. 4. Approximation of a contour by a rectangular step curve. 

Substituting from Eqs. 65 to 68 shows that 

^f(z) dz = 0 [70] 

As illustrated crudely in Fig. 4, a given closed contour C of finite size 
may be thought of as approximated by a rectangular step curve. The 
approximation becomes better and better as the size of the steps is made 
smaller and smaller. The integral around the closed contour C may be 
replaced by the sum of integrals around all the enclosed small rectangles 
(all taken in the counterclockwise direction) because the contributions 
from the sides of adjacent internal rectangles cancel, just as in the 
argument leading to the result known as Stokes’s law in vector analysis. 
If the function w = f{z) is differentiable at all points within the region 
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G, the result 70 is applicable to all the enclosed small rectangles, and thus 
the result 59 is again established. The Cauchy-Riemann equations to¬ 
gether with the condition that w be differentiable at all points within the 



ol 

Fig. 6. A multiply connected region. 


enclosed region are again found to be necessary and sufficient for the 
validity of Eq. 59. 

The following remarks about the characteristics of the region enclosed 
by the contour C are necessary. This contour may conceivably have a 
form like that shown in Fig. 5, for which the enclosed region G is the 
shaded area. If the portions of the contour C leading to and from the 
smaller islandlike regions Gj, Ga, and G 3 within G are moved closer and 
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closer together until they finally become superimposed, the contour 
integral around C evidently becomes equivalent to the sum of four 
separate integrals evaluated respectively for the contours C', Ci, C 2 , and 
C 3 with directions of traversal as indicated in Fig. 6 . 

So long Sisw — f (z) is regular within the shaded region G, the integral 
law 59 still holds when evaluated for the contour C of Fig. 5 or for the 
equivalent set of contours C\ Ci, C 2 , and C 3 shown in Fig. 6 . It may no 
longer hold, however, if applied only to the contour C' of Fig. 6 . Actually 
the enclosed regions Gi, G 2 , and G 3 may contain points at which the 
function w = f{z) is not differentiable and therefore, the integrals per¬ 
taining to the separate contours Ci, C 2 , and C 3 are not necessarily zero. 

A region which has embedded in it one or more subregions Gi, G 2 , • • • 
like the region G of Fig. 6 is said to be multiply connected. It is doubly 
connected if it contains one subregion, triply connected if it contains two 
subregions, etc. Unless the contour C in the integral 59 is interpreted in 
the manner illustrated in Pigs. 5 and 6 , the validity of Cauchy's integral 
law evidently requires that the region enclosed by the contour be simply 
connected. 


7. Cauchy’s integral formula 

A given function is assumed to be regular within the region enclosed 
by the contour S shown in Pig. 7. It is also assumed to be regular at all 

points on the boundary S. These 
points are denoted by f, and the 
corresponding values of the func¬ 
tion are expressed by 

w'=/(f) [71] 

A contour integral is now con¬ 
sidered which has the form 



m 

■s (s' - 2) 


[72] 


Here z denotes some point within 
Fig, 7. The region of analyticity in the the enclosed region. If f is for 
derivation of Cauchy’s integral formula is moment regarded as capable 
the boundary 5 and_thc region enclosed ^ny value within the 

enclosed region as well as those on 
its boundary, it is observed that the integrand as a function of f is reg¬ 
ular at all such points, with the exception of the point f = z. At this 
point the integrand becomes infinite, and therefore Cauchy's integral 
law no longer applies; the value of the integral 72 is then not neces¬ 
sarily zero. 



Art.n 


CAUCHY’S INTEGRAL FORMULA 


273 


However, if the point z is surrounded by a circular contour C, and the 
integration is extended over a closed path which consists of the curve S 
and the circle C joined by a line which is traversed in both directions, as 
shown in Fig. 8, the result is evidently zero because the corresponding 
enclosed region is the shaded area where the integrand is regular. It 
follows, therefore, that the value of the integral 72 is equal to that of 


£MAL 

Jc - z) 


[73] 



in which the circular contour C is traversed in the counterclockwise 
direction, and f now refers to points on this circular contour. The correct¬ 
ness of this statement is recognized from the fact that the difference 
between the integrals 72 and 73 is the integral around the composite 
boundary of Fig. 8, which has the value zero. 

The radius p'of the circle C about z is now to be thought of as being very 
small, so small in fact that throughout the process of carrying out the 
integration of 73 the value of /(f) differs from that of /(s)by a negligible 
amount. In view of the fact that/(f) is a continuous function within the 
region bounded by 5, this is a permissible assumption. (It would obviously 
not be permissible if /(f) were discontinuous at the point z.) Now if/(f) 
in the integral 73 is replaced by/(s), it may be taken outside the integral 
sign, because the integration is evaluated with respect to the variable f. 
Thus one has 


Js - z) 


£MAl 

Jc - z) 



dt 

(f - 2) 


[74] 


With reference to Fig. 7, the polar form of (f — z) is 

(f - z) = pe-’* 


[75] 
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and since f is constrained to lie on the circle C, 


df = jpe’’ de = y (f — z) dS 

[76] 

so that 

df 

, . — 1 d$ 

(f - z) 

[77] 

Hence 

[78] 

and consequently Eq. 74 yields 



[79] 

or 

[80] 

This result is known as Cauchy^s integral formula. It enables one to cal¬ 
culate the value of a function of a complex variable at a point within a 
region in terms of its values on the boundary, provided the function is 
known to be analytic throughout the region inclusive of the boundary. 


8. The existence of derivatives of any order 


By means of Cauchy’s integral formula, Eq. 80, it is possible to show 
that a function of a complex variable possesses derivatives of any order 
at a point where the function is regular. The familiar formula for the 
derivative of a function w = /(z) reads 

Hn.it [ 81 ] 

dz L ^2 J 


According to the formula 80, 

— (z + Az) 

Substitution of Eqs. 80 and 82 into Eq. 81 gives 


dw 

^ = limit 
dz Az—>0 


f-.f- 

Js 


(z + Az) 


f - (z + Az) f - z (f - z)2 - Az (f - z) 


[84] 
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so that the limit 83 yields 

^ = J_ 1-851 

dz 2icj Js — z)^ ^ 

The second derivative, according to the form of Eq. 81, is expressed by 


r/ 

= limit — 
A2—>0 L 


(z + Az) — f'{z) 


in which the prime denotes the first derivative. By Eq. 85 




and Eq. 86 therefore ^ves 
.Kt lIttj Js 


As |[f - (s + As)P (r-z)‘ 


r] [88] 


_1_ 1 _2(f —s)As + As^ 

[f - (2 + A2)J' (f - z)^ ~ (f - z - As)^(f - s) 

so that the limit 88 is found to yield 

d'^iv 2 r m di 


i [89] 


dz^ lirj Js (f - 2)^ 

Continuing in this way, one establishes the following formula for the 
n\h derivative: 

^ ^ ”1 ( fJSLllL - ron 

dz^ 2irj Js ^ ^ ^ 


It may be concluded that the function w = /(z), if regular within a given 
region, possesses derivatives of any order for all f)oints of this region, and 
these derivatives may be obtained through differentiating under the 
integral sign in the Cauchy integral formula 80. The existence of but a 
single derivative thus implies the existence of all subsequent derivatives! 
The elegance of this remarkable result can hardly be overemphasized, 
nor is it out of place to call attention to the fact that a similar result does 
not apply to real functions. 

The values of the derivatives of higher order are seen to be unique if 
this is true for the value of the first derivative of a given function. The 
first and all higher order derivatives of a function of a complex variable 
are themselves functions of a complex variable, and these derivative func¬ 
tions are analytic at any point where the given function is analytic. 
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9 . Point sets and infinite series 

Preliminary to the discussion of the expansion of functions in infinite 
series, which is given in the following article, it is helpful to point out a 
few fundamental principles regarding the convergence of such series. 
This subject may best be approached through considering an infinite set 
of points 

Sly S2f *S’ 3 , • • • S^y * * • [^2] 

Visualize the quantities S 2 y etc., as points in the complex plane. They 
may be scattered about completely at random, or the sequence of their 
values may exliibit a tendency to become confined within a more and 
more limited area or region as the index k (identifying individual values 
in the sequence) becomes larger and larger. In the latter case the sequence 
is said to approach a limit and the set of points is said to possess a limil 
point. 

If one considers a number of concentric circles (with finite, nonzero 
radii) drawn about the limit point S in the complex plane in which the 
points Sly S 2 , • • • are indicated by dots, each of these circles, however 
small, contains an infinite number of points. This statement is the defini¬ 
tion of a limit point. Considering a particular circle of radius €, it is possi¬ 
ble to state that some integer n exists such that all points Sk ior k > n 
lie inside this circle. For any given radius e, the ap{>ropriate value of n 
must be sufficiently large to assure that none of the points in the unending 
sequence Sn-^i, • • • lie outside the circle (although some for 

k < n may still be inside) ; or, for a given integer Uy the appropriate radius 
e must be sufficiently large. As the value of n is chosen larger and larger 
the appropriate € may be chosen smaller and smaller since the points be¬ 
come denser and denser in the more immediate vicinity of the limit 
point. The latter, for this reason, is sometimes also referred to as a 
cluster point or as a point of condensation. 

It thus becomes clear that a limit 5 of the unending sequence 5i, ^ 2 , 53 , 
• • • may be said to exist if 

\S — Sk\ < €, for dX\k > n [93] 

in which € is nonzero but may be chosen arbitrarily small, and n is a 
finite integer depending upon e. If this condition is fulfilled, the sequence 
is said to converge to the limit S. 

An important result known as the Bolzano-Weierstrass theorem follows 
from the definition of a limit point. This theorem states that if an unend¬ 
ing sequence of points Si, So, ^ 3 , • * • is confined within a finite region, that 
region must contain at least one limit point. The truth of this statement 
may be seen through considering the region to be subdivided into a finite 
number of smaller ones, for example, squares. Since the number of points 
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is infinite and the number of squares finite, it is dear that at least one of 
the squares must contain an infinite number of points. This one may 
again be subdivided into smaller squares and the same reasoning repeated. 
Through continuing in this way one may state that within the original 
region it must be possible to find at least one nonzero but arbitrarily 
small subregion containing an infinite number of points, whence, accord¬ 
ing to the definition of a limit point, that subregion must contain one. 

The convergence condition 93 may be expressed in an alternate form, 
known as Cauchy^z principle of convergence^ which reads 

— -^nl < €, for a finite n and all p = 1, 2, • • • oo [94] 

According to this statement, a circle drawn about Sn with the finite 
radius e contains all Sk for k > n\ that is, it contains the unending 
sequence * • * , and in view of the Bolzano-Weierstrass 

theorem it must, therefore, contain a limit point. 

Consider now the infinite series 
00 

5=2) = Wl + ^^2 + ^3 “f" • • • [^5] 

n = l 

and its partial stinis 

"b '^2 d” % + * • ' + 

For ^ = 1, 2, 3, • • • these partial sums may be regarded as elements of 
the unending sequence Siy $ 2 , * • • discussed above, and S as its limit. 

If tliis limit exists, the infinite series 95 is said to converge; if the limit 
does not exist, the series diverges. Cauchy's principle of convergence 94 
may be expressed in the form 

\un^i+UnJ^ 2 + ' ’ * +Wn+p| <c, for a finite w and all p = 1, 2, • • • oo [97] 

The quantity \S — appearing in the condition 93 is the absolute value 
of the remainder of the scries 95 after the A’th term. 

Beside the series 95 it is significant to consider the one expressed by 

a = 2) \tin\ = l^i! + 1 ^ 2 ! + l^ai + • • • [98] 

71 =1 

in which the terms are the absolute values of corresponding ones in 95. 
Since the remainder 

l^n+l + ^71+2 + + • • ’I [99] 

of the series 95 is always smaller than the remainder 

|wn+ll + kn-Hal + + • * * [100] 

of the scries 98, it follows that 95 is surely convergent if 98 converges. 
Jn the latter event the series 95 is said to be absoliUcly convergent. 
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A suflScient test for the absolute convergence of the series 95 is ex¬ 
pressed by the condition 

limit [«„[*/» < 1 [101] 

To prove this statement one should first observe that no matter how the 
limit of is approached as n is allowed to become larger and larger, 

whether monotonically from above or from below or in an oscillatory 
fashion, the fact that the limit is less than unity enables one to state that 
there must always exist a finite value of n such that for k > w, 
g p < 1. Denoting the partial sums of the series 98 by Cny one 
may write 

|(rn^p —(Tnl^ |wn4.l| + |wn+2|+' • *+l^n+j)I ^ + * [102] 

or 

M— 

kn+p“"0rnl^p"“^ni+P+P^+* • •+P^^) = P^'^^ -Tj-T <:j- [103] 

U—p; 1—P 

If one chooses p^'^V(l — p) = e, then € can be made arbitrarily small 
through the choice of a sufficiently large n. Therefore the condition 101 
leads to the result 

|<rn+p — ^n\ < €; for a finite n and all /> == 1, 2, • • • oo [104] 

which is Cauchy’s condition 94 for the convergence of the series 98. 

If approaches a limiting value p > 1 as becomes larger and 

larger, the series 95 diverges since |w„| —> p” > 1 for large n, in violation 
of the obvious necessary convergence condition Wn —^ 0 for w oo. 

Sometimes the test 101, for one reason or another, is not applicable and 
onemust employ other means for examining the convergence of a series. 
A useful alternate method is the Alembert ratio test which is expressed 
in the statement: If in addition to |wn| 0 forn —> , one has 

^ < p < 1 for aU A > « [105] 

the series 5, Eq. 95, is absolutely convergent. 

To prove that this condition insures the fulfillment of the Cauchy 
condition 94, one may begin by observing that 

|«n+l| < i«n|p 
|«n+2| < |«n+l|p < \Un\f>^ 

l«n+3l < |«n+l|p^ < 1«„1 p® 

etc. 


[106] 
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Hence 

—<rn| == |wn-fi| + |«n+2|+* * * + |Wn+p| < [Wn| (p + P^ + P^ +* * •+P^) 

[107] 

or 

___ p+i 

k„+p - O-nl < |«nl X ^ 7 —^- < |m„| 7 -^ [108] 

Since Mn 0 for w —> 00 , one can always find a value of w beyond 
which Wn p/(l — p) is equal to or less than an arbitrarily small nonzero €. 
Hence the Cauchy criterion is met. 

Another useful method is the so-called comparison test, according to 
which the given series 95 is compared with another series 

00 

§ = Ti, Vn = Vi V2 + Vz -\ - [109] 

n =1 

Thus if S is known to be absolutely convergent and \un\ < C| 7 ;„|, where 
C is any finite positive constant, the series S must be absolutely conver¬ 
gent. The series § is referred to as the dominant of S (or is said to dominate 
the series 5). 

Trivial as this test may seem to most engineers, it is nevertheless ver>^ 
useful, particularly when both the preceding methods of testing for 
absolute convergence fail. An exiimple is furnished by the series 

■■■ 


Here 



—* 1 with « —♦ » for all finite r 


This last result may be seen by observing that 



[ 111 ] 

[ 112 ] 


Since the quantity in the parenthesis becomes zero for « 00 the result 

111 follows at once. It is clear that the condition 101 is not met for any 
finite nonzero r, and yet one cannot say with certainty that the series 
diverges, since inequality 101 is a sufficient, but not necessary, condition 
for convergence. 

The criterion 105 for the d’Alembert ratio test likewise leads to an 
indecisive result, namely, one has 

for«-»oo [113] 
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The convergence of the series 110 may be investigated through first 
determining another series which dominates it. To this end one writes 


5 = 





and so forth. It is clear, therefore, that the series 

§ = £ (2^“")" = 1 + (2*“0 + (2’“’’)^ + ‘ • [116] 
n “0 


dominates the series 110 or 114. The right-hand side of Eq. 116 has the 
form of the power series 

5 = ^ = i + z + + • • • [117] 

n =0 

for which = |z|, so that the condition 101 reads 

Izl < 1 [118] 


With regard to the series 116 the corresponding condition leads to 

l2*-"| <1 or r > 1 [119] 

When this condition is fulfilled, the series 110 converges. 


For r = 1 this series reads 

s = 

f 1 

n>»0 ^ 

and 


l^n+p ~ ^nl = 

1 

« + 1 


1 _L 1 _1_ 1 


+ -T-^ + ---+ ^ 


n + p 


n + p 


[ 120 ] 


[ 121 ] 


For no finite n, however large, can this quantity be less than an arbi¬ 
trarily small (nonzero) e for all /> = 1, 2, • • • », since for /> > w its value 
approaches unity. Therefore the series is divergent for r = 1; and it is 
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certainly divergent for smaller values of r since the terms in the corre¬ 
sponding expression 121 then are all larger than they are for r = 1. 

Absolutely convergent series have the important fundamental property 
that their values are unaltered through a rearrangement of the terms. A 
convergent series that is not absolutely convergent is referred to as being 
condilionally convergent. The value of such a series can very definitely 
be altered through a rearrangement of its terms. In fact Riemann has 
shown that a conditionally convergent series can be made to have any 
finite value for its sum through an appropjriate grouping of the terms. 

For example, the series 

5 - i - i + i + [122] 

n=l n 

is evidently not absolutely convergent since the sum of the absolute 
values of its terms is the scries 120 which is divergent. It is not difficult to 
see by inspection, however, that the series does approach a finite limit 
in an oscillatory fashion. This limit may be computed to any desired 
accuracy, taking the terms in their given order. One thus finds 
S = 0.69315 • • • which, by other means, may be shown to be the decimal 
fraction approximation to In 2. If the terms are now rearranged as follows 

‘S' = 1 + i ~ i + i + T ~ i + i + IT -- i + • • • [123] 

and the limit is again computed, one finds 

S == 1.03972 • • • = 1.5 In 2 

When a given series is not absolutely convergent, its possible condi¬ 
tional convergence may be investigated in the following way. Let the 
series be written in the form 

00 

s= i: anVn [124] 

n =1 

in which an and Vn are any two parts into which the typical term of the 
series is separable (one may need to make several trials at this step in 
order to find an appropriate separation). Defining the quantities 

§1 = ai 

§2 ~ “b ^2 

§3 — ai a2 [125] 


+ ^2 + • • • + ^71 


one may rewrite the series 124 as 

5 = §1(7^1 — ^>2) + §2(^2 “ ^3) + §3(^3 “ ^4) + • • • [ 126 ] 
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with the partial sums 

5„ = Si(»i-» 2) + §2(02-»3)H-i-Sn-l(l'n-l-»n) + SnJ'n [127] 

Thus one finds 

1‘S'n+p “ "^nl ~ I "h Sn(®n ®n+l) “I" ‘ ‘ ' 

"h ^n+p—1 (j'n+p—1 Dn+p) 4" Sn+p^'n+pl 
<]§„! • |»„| + |§„| ■ \Vn - V„+i\ + • • • 

“}" |Sn-|-p— 1 1 * 1 Z^n+p| “f” l^n-f-pj * |^n+p| 


Now if 

\§k\ ~ 1^1 + ^2 "f" ^3 4“ * • • “1“ ^&| ^ A for Q-ll k [129] 


with A finite, 

l^n-fp »^n| 4~ I^n+pl 4“ (I^n ^n+11 4" ^n-f2| 

4- * * * 4- \vn+p-i — ^^n+pl)} [130] 


Next, if 


K ~~ ^^n+il convergent [131] 

1 

so that 

\(Tn+p-^n\ = | 4" -“^n+2!4-h [^^n+P-l “^n-fpl <^1 [132] 

for a finite n and all /? = 1, 2, * • • oo, and if further 

\vn^p\ < €2 for all = 0, 1, 2, • • • [133] 

the condition 130 becomes 

l^n+p — ‘S'nl < A(€i 4~ 262 ) = € [134] 

for a finite n and all /> = 1, 2, • • • qo . The series 124 is then convergent, 
and the conditions 129, 131, 133 constitute a test (known as the Dedekind 
test for conditional convergence) which may be used to reveal this fact. 

As an illustration the method may be applied to the series 122. Here 
one may let 

an = (-I)’*~S »« = - [135] 

fl 

Then §„ = 1 or zero and hence remains bounded for all values of n 
(condition 129). Terms in the series 131 have the form 

, _ 1 _ 1 _ 1 

®n ^'n+ll ^ « -f 1 n{n + 1) 


[ 136 ] 
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This typical term is smaller than l/«^, and since the series with as 
its typical term is convergent, the comparison test reveals the convergence 
of the series 131 in the present example. Finally the condition 133 is 
evidently met since in 135 approaches zero monotonically with in¬ 
creasing n. Thus the conditional convergence of the series 122 is proved. 

In the majority of problems in which infinite series appear, the terms 
of the series are functions of some independent variable, and its sum is 
likewise regarded as a function of this variable. For example, in the power 
series 117 the quantity z may be assumed to have any complex value. 
It does not necessarily follow, however, that the infinite series represents 
a function of this complex variable since values of the series are not 
related to values of the variable unless the series is convergent. 

If for all points of a given region in the z-plane the series is convergent, 
it is .said to be uniformly convergent in this region, and the series may 
then be regarded as there representing a function of the complex variable 
z. As the condition 118 shows, the power series 117 is convergent for all 
poipts lying inside the unit circle about the origin. This is its region of 
absolute and uniform convergence. If the power series is written 

to 

S.^ 2 "h "f* (l2Z^ + [1371 

n *=0 

then the convergence condition 101 becomes 

limit ^ ^ [138] 

n —> 00 

or 

,i<_^_ 

limit 

n—* ao 

This series converges absolutely and uniformly within a circle about the 
origin having the radius 

_ 1 
limit 

n—► 00 

This circle is called the convergence circle (also circle of absolute convergence) 
of the power scries 137. 

For points outside the convergence circle the series diverges, for there 
the inequality in the condition 138 is reversed. The series may still con¬ 
verge for some points on the circle, but for at least one such point the 
series must be divergent otherwise the radius of the convergence circle 
could be chosen larger than the value given by Eq. 140, and this conclu¬ 
sion is in conflict with the condition 138. 

The statements just made with regard to the power series are unaltered 
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if the variable z is replaced by (2 — 20 ) except that the convergence circle 
is then centered at the point 2 = Zq. 

To say that an infinite series converges uniformly at some point 2 = 2 i, 
is equivalent to saying that the series converges not only at this point 
but also for all points witliin a circle about Zi with a nonzero but arbi¬ 
trarily small radius. When this condition is met the term-by-term deriva¬ 
tive of the series yields a resultant convergent series that correctly 
represents the derivative of the function defmed by the given series, and 
an analogous statement may be made with regard to term-by-term 
integration. Within a region of uniform convergence one may, therefore, 
carry out the differentiation or integration of a function defined by an 
infinite series through applying the identical process to each term and 
summing afterward. The resulting series, however, may or may not 
possess the same region of uniform convergence. 

Power series have the interesting property that their term-by-term 
derivative or integral yields resulting series with the same region of uni¬ 
form convergence. This fact may easily be proved. The series obtained 
through differentiation and integration of 137 are respectively 

= £ nanz'^-'- and [141] 

n *0 n-OW +1 

The condition 101 applied to these series reads 

I^H+d/n) <• 1 |-142] 


Since 

limit = limit — 

n—> « n—► « \n + I 

(as may be seen through considering the logarithms of the expressions 
subjected to the limiting process n—^co) it becomes clear that the con¬ 
ditions 142 coincide with the condition 138, and hence that the series 
141 have the same convergence circle as the series 137. 

These matters pertaining to uniform convergence of series may be 
illustrated through considering the straight-forward expansion of some 
simple algebraic functions. For example, if one divides (1 — 2 ) into unity 
by continuing the process of long division, there results 

7 -^^— = 1 + 2 + 2 ^ -f 2 ^ -f- 2 ^ + • • • [144] 

which is the power series 117. For values of z within the unit circle this 
series identically replaces the function 1/(1 — 2 ), whereas for values of 
2 outside this circle the series and the function 1/(1 — 2 ) have entirely 



limit < 1 and limit —^ 

n—> w n—> 00 It -f- 1 



Art.OJ 


POINT SETS AND INFINITE SERIES 


285 


different values. Near the point 2=1 both the series and the function 
have values that increase without limit, whereas at the point s = — 1 , 
Eq. 144 yields 

i = + + +- [145] 


The series is evidently divergent at this point, for it fails to approach a 
limit. Hence there is no reason to become puzzled about this result since 
the function and the series may be identified only where the latter 
converges. 

However, in view of the fact that conditionally convergent series, 
through a particular arrangement of their terms, may be made to yield 
any desired sum, one is led to inquire whether a divergent series like the 
one in Eq. 145 may nevertheless be summable through the application 
of some special process. 

This question, in the past, interested a number of mathematicians — 
CesJiro, Holder, Euler, Abel, Borel, etc. — and the summation procedures 
developed by them are connoted by the letters C, H, E, A, B, etc., 
respectively. Thus if, for example, a particular series is summable through 
applying the Cesaro procedure, one abbreviates this statement by saying 
that the series is C-summable, This particular process of summation is 
now discussed in some detail. 

With reference to the series 95 and its partial sums 96, consider the 
sequence 


52 


Si = Ui 

^ 1+^2 . «2 

—— 




^^1 + -^2 4 ~ ^3 
3 


== wi + 


2 

3 


^2 + 2 ^3 


[146] 




$1 + ^2 “ I " 


ft 


= «1 + + • • • + 


which is referred to as an arithmetic mean sequence of the first order (if 
this sequence is subjected to the same process the result is said to be of 
second order, etc.). A limit of the sequence 146 exists so long as $n 
remains finite for unlimited values of n. It is not necessary that the terms 
of the series 95 have the property Un 0 for oo, but, if they do, one is 
led to the result 


limit 

n —► 


/ 


1 2 \ , 

1 1 

«1 + ( 

1 — - ) W 2 + ( 

1 -) W 3 + • - 

• • 4- Un\ 

1 \ 

n/ \ 

nj 

n \ 


= limit {Sn) 

n—> so 


[147] 


That is, the new sequence then apparently has the same limit as the 
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sequence of partial sums Sn, a conclusion that should, however, be ac¬ 
cepted with obvious reservations. 

For the series in Eq. 145 the partial sums are 

Si = 1, 52 = 0, 53 = 1, S 4 = 0, ■ • • [148] 

from which it is clear that 

limit {Sn) — limit |£l-i_£ 2 _+-jl£?| _ ^ [149] 

Thus the left-hand member of Eq. 145 is interpreted as the Cesiro sum 
of the divergent series on the right. This type of summation will be 
used in connection with Fourier series in the following chapter. 


10. Taylor's and Maclaurin's series 


The point of departure in the present argument is Eq. 79, which is 
repeated below: 


£M1L 

Jc {i -z) 


= 2^7(2) 


[ISO] 


Here the contour integral is assumed to be evaluated for a circular path 
C with its center at some point Zq. Writing 


_i _ 1 _ 

f - Z (r - 3o) - (s - So) 


[151] 


one obtains, by the process of long division, the scries 

1 ^ 1 S - Zq (z - Zq)^ _ ^ 

f-z - Zo (f- Zo)“ (f - Zo)^ 


[152] 


which, according to the theory of infinite series discussed in the previous 
article, is known to be uniformly convergent for 



[153] 


Since the center of the circular contour C lies at the point and f lies 
upon the circle, this condition for uniform convergence is fulfilled for all 
points 2 within the circle. Because of its uniform convergence, the 
series representation for 1 /(f — z) may be substituted into the integral 
Eq. 150, and the integration carried out term by term. This process gives 


2 ^/( 2 ) = 


m dt 

(f - Zo) 


+ (»- *.) £ 
■f (z - Zo)- ^ 


/(r) 

- Zo)^ 

/(r) dr 

(f - Zo)* 


+ ... 


[ 154 ] 
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A series representation for the function w = f{z) is thus obtained which 
reads 

/(z) = fflo + Oi(z - 2o) + aziz - Zo)® + Osiz - Zq)® H- [155] 

with 



(f - 


[156] 


Equation 155 is recognized as Taylor’s series representation for the 
function f(z) in the vicinity of the point Zq, and Eq. 156 yields the 
coefficients for this expansion. Since the validity of Eq. 150 requires 
that the function /(z) be regular throughout the region enclosed by the 
contour C, and the series 152 or 154 is uniformly convergent only for 
points within this circular contour (because of the condition 153), it 
follows that the Taylor series 155 converges uniformly only within a circle 
about Zq whose contour reaches to the nearest singularity of the function 
w = f{z). 

It is useful to note that, by means of Eq. 91, the relation for the 
coefficients of the Taylor series expressed by Eq. 156 may be written in 
the alternate form 



which is recognized to agree with the familiar form used for the expansion 
of functions of a real variable. The Taylor series is thus found to be avail¬ 
able in unaltered form to functions of a complex variable. The Maclaurin 
series evidently applies also to functions of a complex variable, since it 
is identical with the Taylor series for the special case Zq = 0. 

If the Taylor series, Eq. 155, is differentiated term by term, it is 
observed, according to the formula 157, that the coefficients in the re¬ 
sulting series are those for the expansion of the function df/dz about the 
point z = Zo, and hence that this result represents the Taylor series for 
the derivative of/(z). The truth of this statement may be shown through 
starting with Eq. 150, differentiating under the integral sign (as per¬ 
mitted according to the conclusions of Art. 8), and substituting the square 
of the series 152 for the quantity 1/(f — z)^, obtaining in place of Eq. 
155 a series for the function df/dz. 

One may conclude from this reasoning that the term-by-term dif¬ 
ferentiation of the Taylor series is permitted and yields the Taylor series 
representation for the derivative of the given function. Moreover, the 
resulting series has the same region of convergence as that for the given 
function, as may be seen from the discussion in the previous article or 
from the fact (brought out in the closing sentence of Art. 8) that the 
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derivative of a function of a complex variable is again a function of a 
complex variable and possesses the same region of analyticity. From an 
ob\dous continuation of the same argument one sees that these conclusions 
apply to derivatives of any order. 

Collateral to these considerations is the fact that the Taylor expansion 
of a given function is unique. To demonstrate this fact, assume that a 
series representation having the form of Eq. 155 is given, and that this 
series is somehow known to represent the function/(s) within an arbi¬ 
trarily small region in the immediate \dcinity of the point 2 = Zq* The 
given series must be the Taylor expansion for /(s) about the point z = Zo, 
because the behavior of the function in this vicinity completely de¬ 
termines its successive derivatives there. That is, differentiating the given 
series and substituting the results into Eq. 157 demonstrates that the 
coefficients are identical with those of a Taylor expansion about the same 
point. 

11. The principle of analytic continuation 

One of the most interesting things about the theory underlying the 
Taylor expansion is that the mere knowledge of a function within an 
arbitrarily small region in the vicinity of some point Zq completely de¬ 
termines that function at all other f)oints within the convergence circle 
about that point. The purpose of the present article is to call attention 
to the even more remarkable fact that a function of a complex variable 
is determined throughout the e^itire z-plane* from a knowledge of its 
properties within an arbitrarily small region of analyticity. t 

The first step in the process of carrying out such a determination is to 
write down the Taylor series about the point Zq where the function and 
its successive derivatives are known. Some other point z'o within the 
convergence circle for this Taylor series may then be chosen as the center 
about which a new Taylor series is determined. This choice can always 
be made, because the original series may be used for calculating the values 

*This statement is subject to some restriction when the function in question possesses 
what is known as a natural boundary,every point of which is a singularity. In such an example, 
either the function docs not exist beyond this boundary or its behavior there is governed by 
an entirely separate definition, in which case it is perhaps more appropriate to say that one 
is dealing not with a single function “but actually with two separate functions. In order for 
the reader to appreciate that these ideas are not merely of an academic nature, his attention 
is called to the fact that natural boundaries of the sort referred to here do occur in practical 
problems. For example, the functions representing the fields in the cross-sectional plane of 
a wave guide possess as their natural boundary the walls enclosing these fields. 

fit is not even necessary to know the function at all points within an arbitrarily small 
region about Zq\ it is sufficient to know the values of the function, in the interior of the region, 
for all points of a finite but arbitrarily small line segment, or in a set of discrete points which 
have a limit point. 
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of the successive derivatives of the function in the p)oint s'q. Unless every 
point on the original convergence circle is singular, the point z'o can always 
be so chosen that the new convergence circle about z^o encloses a portion 
of the region lying outside the original circle. Since the two circles partially 
overlap, the two Taylor series have a certain convergence region in com¬ 
mon where the function is determined by either series. The second series, 
however, enables one to calculate values of the function at points within 
a circumscribed region lying beyond the boundaries which limit the 
representation of the function by means of the first series. One speaks of 
this process as an analytic continuation of the function into the newly 
acquired region. 

By properly choosing a third point 2"o within this newly acquired 
region and using the second series for the calculation of the successive 
derivatives of the function in this point, one obtains a third Taylor 
series whose convergence circle encloses a portion of the a-plane which 
lies beyond the boundaries given by either of the first two convergence 
circles. The third Taylor series, therefore, represents a further continua¬ 
tion of the same function. 

In order to obtain such a further continuation it is, of course, not neces¬ 
sary that the third point z"o be located outside the first convergence 
circle, since the selection of this point may be regarded merely as a re¬ 
vision in the choice of the second point s'o- It should be easy to appreciate 
that this procedure may be continued in a variety of ways so as to obtain 
numerous overlapping convergence circles and corresponding series 
representations by means of which the function is ultimately determined 
within any desired region of the z-plane except for the singular points 
of the function. 

The process of carrying out an analytic continuation in this manner 
and of obtaining a succession of partially overlapping convergence circles 
which extend the known region for the function into a continuously 
expanding portion of the s-plane may be regarded as a process of succes¬ 
sively acquiring access to additional area in the s-plane after the fashion 
that a harvester, cutting grain with a scythe, successively acquires 
additional stubble ground by executing a continuous series of semi¬ 
circular slices. If for the moment one imagines this harvester to be doing 
a rather unsystematic job, it is conceivable that he may cut a swath or 
path which circles about a portion of the grain field and returns so as to 
overlap itself. If the process of analytic continuation is carried out in this 
manner, one expects, in the overlapping portion, to regain the same values 
of the function as were obtained previously. This, however, may or may 
not be the case, for the function may be multivalued, and in returning to 
the original portion of the 2 -plane one may find oneself located on a dif¬ 
ferent leaf of the Riemann surface* characterizing that multivalued 

'''These matters are discussed in further detail in Arts. 17 and 18. 
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function. In fact it is possible to find, after returning to the original 
region, that a point at which the function was observed to be regular 
when this region was first encountered is now a singularity of the function. 

The significent matter here is that the process of analytic continuation 
is applicable whether the function is single-valued or not, and that even 
a multivalued function with all its manifold characteristics and peculiari¬ 
ties is completely determined from a knowledge of that function over an 
arbitrarily small region of analyticity on a single leaf of its Riemann 
surface. 

It follows also from these considerations that any two functions of a 
complex variable whose values coincide over an arbitrarily small region 
of analyticity, or for all points of a finite but arbitrarily small line segment, 
or for a set of discrete points having a limit point, must have identical 
values throughout their common region of analyticity and hence must 
there be identical. This statement is known as the identity theorem or 
uniqueness theorem for analytic functions. 

If the common region of analyticity possesses a natural boundary, 
nothing is implied regarding the behavior of the functions within other 
possible regions of analyticity. The theorem likewise does not imply 
that the behaviors of the two functions are identical at isolated singulari¬ 
ties located within their common region of analyticity, but these matters 
are practically irrelevant inasmuch as a function is usable only where it 
is analytic, and no difliculty can arise from assuming (if this be desirable) 
that the functions are identical everywhere else. 

The arbitrarily small line segment over which the function is initially 
known may be a portion of the real or imaginary axis in the s-plane. A 
real function of a real variable may be regarded as a function of a com¬ 
plex variable whose independent and dependent values l)oth happen to be 
on the real axis. If it is possible to continue such a function into the 
complex domain, that continuation is unic|ue and is immediately obtained 
by the simple expedient of replacing the real independent variable x by 
the complex variable 2 = 0 : + jy. The truth of this statement, expressing 
a property of functions known as their permanence of form, follows di¬ 
rectly from the identity theorem, since the given real function and its 
continuation obviously coincide for points on the real axis. 

12. Singular points and the Laurent expansion 

Since the singularities of a function of a complex variable are, so to 
speak, the mainsprings upon which its very existence depends, it is usually 
of chief interest in the study of a given function that characteristics of 
the function be investigated in the immediate vicinity of these singular 
points. For this purpose the Taylor series is of little service, because the 
vicinities of singular points are the very regions where its convergence 
fails. Consequently it is of considerable importance to search for a type 
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of expansion whose sphere of usefulness is centered about a singular point, 
that is, an expansion which places the character of a given singularity 
in evidence. 

A few preliminary remarks concerning singularities will be appropriate 
preceding the detailed discussion of how such an expansion is found. 
Quite generally one must admit the possibility that a given function may 
be singular (nondifferentiable or nonanalytic) not only at certain discrete 
points but also at all points comprising a finite region in the 2 -plane. 
If the latter is the case, and a particular point within this region is 
singled out, it is not possible to discover an immediately surrounding or 
neighboring space, however small, in which the function is analytic. 
In other words, the singular points within such a region are infinitely 
dense. 

For the considerations of the present article, such singular regions 
must be ruled out. Indeed, it is not i>ossible to discover any kind of scries 
expansion which can represent a function in the vicinity of a point lo¬ 
cated within a region of this sort. From a practical point of view this is 
hardly discouraging, however, inasmuch as functions which p)ossess such 
singular regions are seldom encountered in engineering work.* The present 
discussion, then, will apply only to singularities for which it is possible 
to discover an immediately surrounding region in which no other singular 
points lie. These are called isolated singularities. 

With reference to Fig. 9, 20 represents a point at which a function 
^ =/(^) has an isolated singularity. About this point as a center are 
drawn a small circle c and a larger one C. The given function may have 
other singularities within the smaller circle or outside the larger one, but 
it is assumed to be analytic and single-valued at all points such as the 
point z inside the annular space between the two circles. Cauchy’s in¬ 
tegral formula, Eq. 79, is, therefore, applicable to the composite contour 
consisting of the two circles and the path joining them, traversed con¬ 
tinuously as indicated in Fig. 9. Since the path joining the circles is 
traversed in both directions, the resulting form of Eq. 79 maybe written 


2vjJ{z) = 


m 

({■ - z) 


/(r) 

(f - z) 


[158] 


in which the larger circle is traversed in the counterclockwise direction, 
the smaller one is traversed in the clockwise direction, and f refers to 
points on either of the two circles. 

For the integral over the large circle, the series 152 for l/(f — 2 ) 

*11 may be pointed out in this connection that in terms of the analogy to physical flow 
fields (as discussed in Art. 5), the continuously distributed sources or vortexes (spatial distribu¬ 
tions of electric charge or current densities, for example) constitute just such singular regions. 
However, the solution of practical problems dcxiling with these situations fortunately does not 
require the series representation of functions within these regions. 
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converges unifonnly because the condition 153 is fulfilled. For the integral 
over the small circle, this statement is no longer true, because the point 



Fig. 9. The composite contour to which Cauchy’s integral formula is applied 
in the derivation of the Laurent expansion. 


2 lies outside the small circle and hence |2 — So| > 
151 must be replaced by 

1 ^_ ^1 _ 

f - 2 “ (2 - 2o) - (f - 2o) 


f — So|. Here Eq. 


[159] 


whence a process of long division yields the series 

1 ^ _ 1 _ (r - zq) _ (f - gp)^ 

f — 2 2 — 20 (a — 2o)^ (s — 2o)® 


[160] 


which is vmiformly convergent for 


2 - 2o 

f - 2o 


> 1 


[161] 


It thus becomes clear that for l/(f — 2 ) one may substitute the series 
152 into the first integral in Eq. 158 and the series 160 into the second 
integral, and carry out both integrations term by term. Equation 158 
then becomes 


2ir//(2) = 




- (2 - 2o) 


— 1 


" ' '■ (f-So)-* 


« (f 2o)' 

- (2 - 2o)“® 


/(f) 

(f - 2 o)-2 


[162] 
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This result may be written in the form 
/(js) = &0 4 * (2 — So) + 62 (s —“ Zq )^ + ^3(2 2o)^ -f. . . . 

+ i(s — 2o)'”^ + 6—2(2 — 2o)~^ + 6__3 (s — So)~^ + . . . [ 163 ] 
in which 


1 f /(f) 

for « = 0, 1, 2, • • • 

[164] 

27r/X (r - Zo)"+* 

-IX /(f)^f 

1 

cs 

1 

1 

II 

8 

>.1 

[165] 

ItjJc (f - Zo)"+* 


Equation 163 is the desired series representation for the function w = /(s). 
It is called the Laurent series. From the derivation just given it is clear 
that the series converges uniformly within the annular region between 
the two circles shown in Fig. 9 where the function w is analytic. Thus the 
radius of the outer convergence circle extends from so to the nearest 
singularity beyond the circumference of the smaller circle, and the radius 
of the inner convergence circle extends from So to the farthest singularity 
inside the larger circle. If the singularity at 20 is the only one inside the 
larger circle, the radius of the smaller circle may become vanishingly 
small, and the Laurent series is then seen to represent the given function 
in the immediate vicinity of the singularity at s<), that is, to represent an 
expansion of w = f{z) about this singularity as a center. 

In connection with the formulas 164 and 165 for the coefficients of the 
Laurent series it should be observed that the direction of traversal about 
the large circle C in the integral 164 is counterclockwise, whereas that 
about the small circle c in the integral 165 is clockwise. If the latter direc¬ 
tion of traversal is reversed, the algebraic sign in Eq. 165 changes from 
minus to plus. The formulas 164 and 165 then differ only in that the first 
is evaluated for the circumference of the larger circle and the second is 
evaluated for the circumference of the smaller one. Since the function 
~ f{^) is analytic in the region bet%veen the two circles, the values of 
the integrals 164 and 165 are the same for any closed contour within the 
annular region or coincident with either circle. Hence the formulas 164 
and 165 may be replaced by a single one which reads 


2^j Js (r - Zo)”+' 


[166] 


in which S is any closed contour within the annular region or coincident 
with either circle, f refers to points on this contour, and the latter is 
traversed in the counterclockwise direction. Since the function w — f{z) 
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is singular in the point Sq, Eq. 91 does not apply for z = Zq and hence 
there exists no alternative difTerential formula for the coefficients 
similar to Eq. 157 for the coefficients of the Taylor series. This circum¬ 
stance is a practical disadvantage because integration is, as a rule, more 
difficult than differentiation. Consequently, when a Laurent expansion is 
to be found, the coefficients are determined, wherever possible, by other 
expedients. Further discussion of this point is given later on. 

When the form of the Laurent series, Eq. 163 is contrasted with that 
of the Taylor series, Eq. 155, the principal difference is observed to lie in 
the fact that the Laurent series contains both descending as well as 
ascending powers of the variable (z — Zq), whereas the Taylor series 
contains only the ascending powers. The portion of the Laurent series 
involving the ascending powers only is called the ascending pari of the 
series, and the portion involving the descending powers is called the 
descending part or priticipal part. It is the principal part of the Laurent 
series which places in evidence the singularity of the function w = f{z) 
at the point Zq. 

The ascending and descending parts of the Laurent expansion may be 
written respectively as 

/i(z) = £ bn(js - ZoT [167] 

n»0 

and 

f 2 {z) = 'L bniz- Zo)’* [168] 

n *—1 

whence Eq. 163 for the Laurent series becomes 

/(z) =/i(z)+/ 2 (z) [169] 

Because the series 152 (which leads to the ascending part/i) converges 
uniformly for all z-values within the larger circle and the series 160 (which 
leads to the descending part / 2 ) converges uniformly for all z-values out¬ 
side the smaller circle (Fig. 9), it follow's that the series 167 converges 
everywhere within the larger circle whereas the series 168 converges 
everywhere outside the smaller one. Both series converge within the an¬ 
nular region between the two circles (this is the common portion of the 
two separate regions of convergence), and this, therefore, is the region of 
convergence for the sum of the two series J167 and 168, which is the 
Laurent expansion. 

The function /i(z) is analytic everywhere within the larger circle, and 
the series 167 is its Taylor expansion about the point z = Zq. The function 
/ 2 (z) is analytic everywhere outside the smaller circle. To interpret the 
series 168 for f 2 (z), it is helpful to consider for the moment a change of 
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variable which amounts to replacing (z — Zq) hy w = l/(z — Zo) which 
amounts to interchanging the roles of points Zq and oo. The series 168 
then becomes one involving only ascending powers of the new variable 
w and represents a Taylor expansion of the function about the point 
w = 0 (which corresponds to a Taylor expansion about the point 2 = oo 
according to the change of variable considered). It is helpful in this 
reasoning to think in terms of the complex sphere rather than the complex 
plane, for then the points s = So and 2 = <» arc simply two points on the 
sphere and the interchange of the parts which they play is easier to 
visualize. One is thus led to recognize that the descending series 168 may 
be regarded as a Taylor expansion of the function 72 ( 2 ) about the point 

Z = CO , 

According to this interpretation the Laurent series represents the given 
function by means of two Taylor series, one about the point 2 = Zo (this 
is the ascending series for/i) and one about the point 2 = 00 (this is the 
descending series for 72 ). The function fi{z) contains only those singu¬ 
larities oif(z) which lie outside the larger circle about Zo^fziz) contains 
only those singularities oi f(z) which lie within the smaller circle. This 
circle may alternatively be regarded as one which is drawn about the 
point 2 = 00 as a center, whence the region within the circle (actually 
the region outside the smaller circle) becomes the region of analyticity 
for the function 72 ( 2 ). The change of variable indicated by (2 — 20 ) —^ 
1/(2 — 2 o) evidently interchanges not only the points 2 = 20 and z = « 
but also the roles played by the functions fi{z) and 72 ( 2 ) and their series 
representations as given by Eqs. 167 and 168. 

From the uniqueness theorem discussed in the preceding article it fol¬ 
lows that the Laurent expansion is unique, since tw'^o series representations 
having identical regions of convergence and yielding identical values for 
all points within this region must be identical. This fact has practical 
significance, particularly with regard to the Laurent expansion, because 
it means that if a representation having the form of Eq. 163 is found for a 
given function in the vicinity of one of its singularities, this representation 
must be the Laurent series for that region irrespective of the method by 
which it is determined. In other words, the coefficients need not be 
calculated by means of the formula 166, but may be found by any other 
expedient which proves to be most effective in the given circumstances. 

13. Kinds of singularities and the classification of functions 
IN terms of them 

If the smaller circle c of Fig. 9 encloses no other singularities except the 
isolated one at the point 2 = Zq, the principal part (Eq. 168) of the 
Laurent series (Eq. 163) characterizes the nature of that singularity. If 
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the principal part contains a finite number of terms, the singularity is 
referred to as a pole. The principal part may then be written 

h{z) = 6 — 1(2 — 2 o)~^ + 6 ^ 2(2 ■“ 2 o)~^ + * • • + 6 _s (2 — So)"”* [170] 

in which the highest negative exponent s is called the multiplicity or order 
of the pole. A pole of the first order is also called a simple pole. 

The principal part h{z) may have an infinite number of terms, in which 
case the function /( 2 ) is said to have an essential singularity at the point 
z = Zq, At a p)ole-the function f{z) becomes infinite, but in the vicinity 
of an essential singularity the function may assume any assigned value 
depending upon the manner in which this singularity is approached.* The 
function w = for example, has an essential singularity at the point 
2 = oof, and the function w = has essential singularities at the 

points 2 = 0, TT, 27r, • * * . For the function 

f(z) = (cos y + i sin y) = u + jv [171] 

one may recognize this peculiarity by noting that 

= V [172] 

and 

tan y = - [173] 

/ u 

Consider an arbitrary choice of values u and v. It is then possible to allow 
2 to approach infinity along a path, parallel to the y-axis, designated by 

= In since this value of x satisfies Eq. 172. Equation 173 

may also be satisfied along this path for an infinite number of values of y 
which tend to infinity. Also, if 2 approaches infinity along the negative 
real axis, e* becomes zero, and if 2 approaches infinity along the positive 
real axis, becomes infinite. 

Not only is a pole a milder form of singularity, but the behavior of the 
function in its vicinity is a very definite one. For a pole of multiplicity s^ 
multiplication of f{z) by the factor (2 — ZoY yields a function which is 
regular in the point 2 = Zq. This circumstance may be regarded as a test 
whereby an ordinary pole may be distinguished from any other kind of 
singularity. 

Other kinds of singularities, particularly those found in multivalued 
functions (branch points), are discussed in a subsequent article. In the 
meantime it is useful to point out how certain types of single-valued func- 

•Theorem of Casorati-Weierstreass. 

tThis characteristic of the function may be recognized from the fact that the Taylor 
series, which in this case converges uniformly in the entire 2 -planc, has an infinite number of 
terms. Note also the discussion of entire functions immediately following. 
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tions may be classified according to the poles or essential singularities 
which they possess. Once more it is emphasized that the singularities of 
a function are the mainsprings of its existence. Without singularities of 
any kind, an analytic function reduces to a constant. 

In this classification one may begin with that type of function which is 
singular only in the point at infinity. Such a function is regular in the en¬ 
tire finite s-plane. It is called an entire function or also an integral func¬ 
tion, and it may be denoted by I{z). There are two kinds of entire 
functions; for one of these the singularity at infinity is an ordinary pole, 
and for the other it is an essential singularity. The first of these functions 
is more particularly referred to as an entire rational; the second, as an 
entire transcendental function. 

Since the entire function is regular in the entire finite s-plane, it pos¬ 
sesses a Taylor series representation for all finite points, which con¬ 
verges uniformly within the entire s-plane. If the function is transcen¬ 
dental, such a Taylor series contains an infinite number of terms. The 
functions sin s, cos s, and are common examples. An entire rational 
function, on the other hand, possesses a Taylor series rei)resentation 
having -d finite number of tenns, the highest power of (s — So) being equal 
to the order of the pole at infinity. The entire rational function, therefore, 
is an ordinary (finite) polynomial; that is, 

J{z) = P{z) = ao + ai(z - So) + a-^iz - ZqY + • • • + a „(2 - Sq)" 

[174] 

in which n is the order of the pole at infinity. For n = 0, the function is 
also regular at infinity, and in this case reduces to the constant a^. 

A second important class of functions arc those referred to as mero- 
morphic. They may be defined as given by the ratio of two entire func¬ 
tions; thus 

M{z) = [175] 

Since /^(s) is a finite or an infinite polynomial, it may become zero at a 
finite or at an infinite number of points in the j:“plane. If / 2 (-) is thought 
of as factored in terms of its roots (these are called the zeros of / 2 ), it 
becomes clear that, at these points, M (g) has ordinary poles whose 
orders equal the multiplicities of the roots of 70 ( 2 ). The factored form of 
72 ( 2 ) is its finite or infinite product representation, and this form places 
the poles of the function M{z) in exddence. 

At the point infinity the meromorphic function has an essential singu¬ 
larity if either or both of the entire functions Ii and 1 2 are transcendental. 
M{z) is then said to be transcendental also, but at no finite points in the 
s-plane can this function have singularities other than ordinary poles. 
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The function w = tan 2 is a common example of a meromorphic function 
which is also transcendental. It has an infinite number of simple poles in 
the 2-plane and in addition has an essential singularity at infinity. 

When both Ii and 1 2 are rational (given by finite polynomials), the 
resultant meromorphic function is also rational. At the point infinity, the 
function then has at most an ordinary pole. In other words, a mero¬ 
morphic function whose singularity at infinity is an ordinary pole, is a 
rational function. Rational functions, then, are such having no other 
singularities except poles. Inasmuch as the representation of them is given 
by 


R{z) 


Pi(z) 

Paiz) 


[ 176 ] 


in which Pi and Po are finite polynomials, it follows that a rational func¬ 
tion has a finite number of poles. 


14. Zeros and saddle points or points of stagnation 

If in the Taylor scries representation for the function w = f{z) as given 
by Eq. 155 , the constant term ao is zero but ai is not zero, the function is 
said to have a simple zero in the point 2 = 20. For the immediate vicinity 
of this point, that is, for (2 — 20) < 1, the function is approximately 
represented by the term ai{z — 20) alone. The reciprocal function, 
\/f{z), has a simple pole in this same point, for its representation in this 
vicinity is approximately given by l/a-iiz — 20). 

If both Oq and ai are zero and 02 is different from zero, the function is 
said to have a zero of the second order in the point 2 = 20. For the imme¬ 
diate vicinity of this point the function then is approximately represented 
by the term a2{z — ZqY. The reciprocal function similarly is approxi¬ 
mately represented by 17^2(2 — ZqY and has a pole of second order in 
this point. 

In general a zero is said to be of the order 5 if the reciprocal function has 
a pole of order 5 in the given point. This is the case if the first nonzero 
coefficient in the Taylor series expansion for the function is Og. According 
to the formula 157 for the Taylor coefficients, this condition results if the 
function and its first 5 ~ 1 derivatives all vanish at the point 2 = 20. 

It is also possible that the first s — 1 derivatives of the function are zero 
at the point z = 20 but that the function itself is not zero there. That is to 
say, all the-coefficients ai, ^2, and so forth up to and including are 
zero, but ao is not zero. In this case the function/(z) — Uq, or — ao, 
has a zero of the order s in the point 2 = Zq, but the function w obviously 
is not zero there. Except for the additive constant ao, the behavior of the 
function w in this vicinity is, however, clearly the same as though this 
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point were an 5 th order zero. The terminology used to refer to such points 
must be so chosen, however, as to distinguish them from zeros. For reasons 
of physical interpretation, to be discussed in the following paragraphs, 
they are referred to as saddle points or also as points of stagnation.* 

For the inunediate vicinity of a saddle point of the order 5 — 1, one 
hast 

w — u jv ^ Oq + a,{z — So)* [177] 

The point is a zero of order 5 if ao = 0- The following detailed discussion, 
in which the constant ao is dropped, applies to either zeros or saddle 
points. It is convenient to write 

(z - So) = rc-’'* [178] 

whence 

w — u jv ^ = aar*(cos s<ti + j sin s<t>) [179] 

Equating real and imaginary parts gives 

uacos s<t> [^80] 

V ^ sin s<p [181] 

For the graphical representation, in the s-plane, of the loci for 
u = constant and v = constant, according to the discussion given in 
Art. 5, the relations 180 and 181 are helpful in showing the character of 
such loci in the vicinity of the point Sq- 

These loci are shown in Fig. 10 for the cases 5 = 1, 5 = 2, and 5 = 3. 
The corresponding sketches in P'ig. 11 show how the algebraic signs of the 
quantities u and v change in the vicinity of the point s = So- The pictures 
in Fig. 10 may be regarded as depicting the direction of the gradient 
(u — constant) and the lines of constant altitude (z^ — constant) in a 
mountainous terrain. The picture for 5 = 2, for example, is then seen to 
represent the vicinity of a point which is simultaneously the top of a 
ridge and the bottom of a valley, that is, a mountain pass where a valley 
crosses a ridge. The terrain in such a region evidently has the shape of a 

*The German terminology (of which these are translations) is “ Sattelpunkt or 
“ Staupunkt.” Alternatively the term “ Krcuzungspunkt ” is also used. 

fThc convention of designating the order of a saddle point as being s — i when a zero 
having the same properties is referred to as being of the order 5 arises from the fact that the 
inverse function has a branch point where the given function has a saddle point, whereas the 
reciprocal function (not to be confused with the inverse function) has a pole where the given 
function has a zero. Just as the order of a pole receives the same designation as that of the 
zero of the corresponding reciprocal function, so the order of a saddle point receives the same 
designation as that of the branch point of the inverse function. These matters are discussed 
in greater detail at the end of Art. 18 after the method of dealing with multivalued functions 
is presented. 
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saddle. This fact accounts for the appropriateness of the term saddle 
point. 

For 5 = 3 the terrain has the shape of a saddle which might be designed 
for a three-legged person, or one may say that it is a region where three 
ridges and three valleys meet in a common point. 

Using a hydrodynamic analogy, one may regard the curves for 
u = constant as representing the direction of fluid flow, and the curves 
for V = constant as designating the orthogonal set of contours along 
which the gradient^is zero. The fluid is streaming symmetrically toward 
and away from the point Zq. At this point the fluid is stagnant, thus 



Fig. 10. Loci of constant real and imaginary parts in the vicinity of saddle points 

of various orders. 

suggesting the term point of stagnation as an alternative designation. 

The pictures show, moreover, that if the order of a zero is greater than 
unity (or that of a saddle point is greater than zero), the orthogonality 
of the contours for u ~ constant and v = constant fails in the point 
z = So, since the respective curves there intersect at an angle of ir/ls 
radians. This failure is, however, only apparent inasmuch as the contours 
actually do not pass through the point but are bent sharply at it. Fluid is 
deflected at the point Sq instead of flowing through it. 

From the standpoint of conformal mapping there is also an apparent 
failure in the angular relationships at a zero order greater than one (or at a 
saddle point of nonzero order). If, in addition to the polar representation 
of (s — So) given by Eq. 178, one also writes 

w - ao == [182] 

in which ao may or may not be zero, Eq. 177 shows that in the immediate 
vicinity of the point s = Sq one has 

P = 


[183] 
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and 

Q = ^0 [ 184 ] 

Since (z — Zo) niay be regarded as a small path increment radiating 
from the point Zo in the z-plane, and w may similarly be regarded as the 



Fig. 11 . Algebraic signs of real and imaginary parts in the vicinity of saddle 

points of various orders. 

corresponding small path increment radiating from the point in the 
2 £;-plane, one observes, according to Eq. 184, that if the increment (z — zq) 
is rotated through an angle A0, the corresponding increment w rotates, 
not through the same angle (as the conformality ordinarily requires), but 
through an angle s times as large. 

This apparent failure in the preservation of angular relationships is 
clarified by the recognition that the inverse function z = \l/{w) is multi¬ 
valued and that the point z = Zq is a branch point of the order ^ — 1 for 
this inverse function. The discussion of conformal mapping in Art. 2 
points out that such a pair of maps in the w- and z-planes is a graphical 
representation not only for the given function but also for the inverse of 
it. Consequently one must recognize that although the function given by 
Eq. 182 is single-valued, the multivalued character of the inverse function 
cannot be ignored. 
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Although the detailed properties of multivalued functions is left for 
discussion in Arts. 17 and 18, it is appropriate to point out here how one 
may see that the failure in the preservation of angular relationships is 
only an apparent one. If the point Sq in the s-plane is enclosed by a 
sufficiently small circle c, the corresponding locus in the 2 e>-plane is very 
nearly a small circle c surrounding the point Wq (which corresponds to 
So)- As a point traverses an arc on the circle c, the corresponding point 
on c' traverses an arc s times as great. In Fig. 12, a and b are two small 
radial line segments emanating from the circle c, and a' and b' are the 
corresponding segments in the 2 e^-plane. The angle d between a' and b' is 5 




Fig. 12 . Apparent failure in the preservation of angular relationships at a saddle 

point. 

times that between a and b. If the radii of the small circles c and c' are 
allowed to become still smaller, the line segments appear to radiate from 
the jxiints So and Wq, and one is led to conclude that the preservation of 
angular relationships has failed because one’s attention is focused upon 
the angles 0 and 6 rather than upon the angles between the line segments 
and the circular arcs, which remain equal to 90 degrees. However, if one 
mentally visualizes the situation in the limit as though the small circles 
were still there, it becomes clear that what has happened is not a failure 
in the preservation of angular relationships but rather is the result of a 
peculiar and somewhat misleading behavior of the given function in the 
vicinity of the point s = 2o* This view is borne out by the fact that the 
Cauchy-Riemann equations, guaranteeing the uniqueness of the deriva¬ 
tive, still hold in this point. 

15 . The evaluation of contour integrals; Cauchy’s residue 

THEOREM 

If the formula given by Eq. 166 for the coefficients of the Laurent 
expansion is written for the integer value w = —1, it reads 

^/(s) dz = l-Kjb^x 


[ 185 ] 
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The contour S is in the present discussion assumed to enclose a region 
within which the function f{z) has but one singularity at the point Zq. 
This situation is indicated in Fig. 13. If the coefficient can be deter¬ 
mined in some way (for example, as described subsequently in this 
article), Eq. 185 represents a means for evaluating the contour integral 
for the function f{z) extended around a 
given closed boundary S. 

According to the Cauchy integral law, as 
discussed in Art. 6, the value of this contour 
integral is zero if the given function/(s) is 
regular at all points enclosed by the con¬ 
tour. The present result substantiates this 
fact, for if f(z) is regular also in the point Sq, 
the Laurent expansion about this point has 
no principal part (it becomes identical with 
the Taylor expansion) and hence b^i = 0. 

The present result may be said to repre¬ 
sent a completion of the Cauchy integral law 
in the sense that it yields the value of the 
contour integral whether the function is regular within the enclosed re¬ 
gion or not, and hence it contains the integral law as a special case. 

An interesting alternative way of obtaining this same result is to begin 
by assuming that the contour integral is given and that an evaluation of 
it is sought. Since the singularity at Zo is the only one within the region, 
the contour S may be replaced by a circle C about Zq according to reason¬ 
ing similar to that used in Art. 7 in replacing the integral 72 by the 
integral 73. In other words, the path of integration may be deformed or 
contracted so long as no part of it is allowed to sweep over a singular 
point. Thus 

f{z) dz = ^ f{z) dz [186] 

Now f{z) may be replaced by its Laurent expansion which reads 

m = i bn{z - z^r [187] 

n = — 00 

Because of the uniform convergence of this series, the integration may be 
carried out term by term, giving 

<f f(z) dz= ^ bn ^ (z — Zo)^ dz [188] 

t/ 6 ' n =* — 00 «/C 

If the radius of the circle C about Zq is denoted by p, then 

iz — Zo) = 



Fig. 13. The integral of a 
function about S is de¬ 
termined by the value of the 
residue of the pole at 2 o. 


[189] 
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and 


dz = d<t> 

Equation 188 becomes 

ff(z)dz= i jbnp’'+^ 

Us n = — 00 t /0 


But 


Hence 






lir for w = — 1 
0 forw 5 *^ — 1 


^ f{z) dz = 2 irjh^ 


[190] 

[191] 


[192] 


[193] 


which agrees with Eq. 185. 

The coefficient 6_i is called the residue of f{z) in the point z = so- 
The value of a contour integral enclosing a singularity is, therefore, 

equal to lirj times the residue of the func¬ 
tion in this singularity. This result is re¬ 
ferred to as Cauchy’s residue theorem. 

When the contour S encloses more than 
one singularity, that is, if the function/( 2 ) 
is singular at several points Si, S 2 > * * * 2 * 
within the enclosed region, as indicated in 
Fig. 14, the contour S may be replaced 
by k separate contours each enclosing one 
of the singularities, and the value of the 
contour integral around 5 is seen to be 
given by the sum of individual contour 
integrals around the k separate contours. It becomes clear that in 
this case 

^ /(z) dz = + • • • + [194] 

in which • • • are the residues of /(z) in the points Zi, Z 2 , • • • 

respectively. 

The contraction of the contour S to the several separate contours 
about Zi, Z 2 , • • • may be visualized through supposing 5 to be a rubber 
band which is shrunk in the manner indicated in Fig. 15. The contribu¬ 
tions coming to the net result from those portions of the shrunken contour 
which in the limit become superimposed and are traversed in opposite 
directions evidently cancel. 



Fig. 14 . The integral of a 
function about S enclosing 
several poles is determined by 
the sum of the residues. 
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As a practical means for evaluating a given contour integral, of course, 
this method is useless unless some way is found for determining the 
residue, which is the coefficient of the first term in the principal part, 
Eq. 168, of the Laurent expansion. When several singularities are en¬ 
closed by the contour 5, the residues of the function f{z) are usually 
found separately for each of the singu¬ 
larities. If it is possible to find the first 2 -plane 
term in the principal part of the Laurent 
expansion for the immediate vicinity sur- 
rounding each singularity, this objective ( 

is accomplished. 

The following method for evaluating 

the residue is useful in many cases. If --—-— 

the singularitv of fiz) in So is an ordinary ^ ^ . 

pole, the reciprocal of this function . .. ... 


<^(s) — 


Fig. 15. The contribution of each 
pole to the integral is accounted 
for separately by shrinking the 
contour. 


is regular in Zo and may there be expanded in the Taylor series 

</>(s) = </)(so)+</>^(so) • (s~So)+|</>^^( 2 o) • (s —So)^+ * • * [196] 

in which the primes denote differentiation with respect to z. 

The detailed firocess now varies according to the order of the pole of 
/(s) in So- If this pole is of the first order, ^(so) = 0, but 0^(so) is not 
zero. Division of the series 196 into unity (by the ordinary process of 
long division) yields 

1 S / \ ^ 1 1 ^ f \0 


2 {<t>y 

1 ( 0 ")^ 
4 


10'" 
6 (0')^ 


So) - 


This is the Laurent expansion of /(s) about the point Sq. Hence the 
residue in this case is 


-=(C. 


If the pole of/(s) in Sq is of the second order, 0(so) == 0 and 0'(so) = 0, 
but <t>"{zo) 0. Division of the series 196 into unity then reads 

1 ^ 2 . .22 0'" ^ , 


2 

9 (0")“ 


1 

6 
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from which the residue is seen to be 



[ 200 ] 


When the pole is of higher order, the expression for the residue becomes 
increasingly moje complicated, but the method of evaluation remains 
the same. 

The detailed aspects of the process of evaluating residues may, of 
course, be varied in a great many ways, and the most expeditious course 
de[>ends entirely upon the form of the specific function in hand. Addi¬ 
tional ways of approaching the problem may, in the course of the solution 
of specific examples, suggest still other variations. 

If /( 2 ) has an sih order pole in s = Zq, then 

^( 2 ) = (2 - ZoYfiz) [201] 

is regular in this point. Hence it possesses the Taylor expansion 

\A(z) = ^(20) + ^'(Zo) • (2 — 2 o) + ■ (z — Zo)^ + ' • • [ 202 ] 

Since 

- A- 


substitution of the Taylor series 202 for V'(z) yields the Laurent expansion 
of /( 2 ) about zq. It is then clear that the residue of /( 2 ) in Zq is given by 


{s - lyXdzr^..^ 


[204] 


Sometimes the function ^( 2 ) in Eq. 201 is more conveniently expressed 
as the product of two simpler functions: 


Hz) = m . , 7 ( 2 ) 


[205] 


Suppose that 

{(2) = ao + ai(2 ~ 2o) + a 2 (z — Zq)^ 4. . . . [206] 

and 

viz) = /3o + /3i(2 - 2o) + ^2(z - Zo)^ + • • • [207] 


are the Taylor expansions for these functions about 2 = 20 . Since the 
residue ol f{z) in zq is the coefficient of the term containing (2 — 2o)*~^ 
in the product ? • it is seen that 

b—i = + • • • + Ots^ipQ [208] 


In numerous practical problems the function f{z) in the integral 185 
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has a finite number of ordinary poles in the finite s-plane, all of which are 
enclosed by the boundary 5. At the point infinity, the function may or 
may not be singular. If the complex plane is thought of as replaced by the 
surface of the complex sphere, it is possible to regard the contour S either 
as one enclosing all the singularities of j{z) which occur for finite s-values 
or as one which encloses none of these singularities but merely surrounds 
the point at infmity. In other words, the region which ordinarily is re¬ 
garded as being external to the contour S may alternatively be inter¬ 
preted as being the enclosed region. The latter is, of course, traversed in 
the opposite sense, but for the moment this fact is of secondary impor¬ 
tance. If it happens that the function /(s) is regular at infinity, one is 
confronted with the peculiarity that the integral around a contour 
enclosing no singularities is nevertheless not equal to zero. The unique 
feature about this situation, however, is that the region in question 
contains the point at infinity. Hence one must conclude that the residue 
of a function in the point at infinity is not necessarily zero if the function 
is regular there. In fact, the residue of /(s) at infinity is equal to the 
negative sum of its residues in all its singularities which occur for finite 
z-values. 

A simple example may illustrate this point more specifically. Suppose 
/(z) = 1/z. This function has a simple pole at s = 0 (with the residue 
unity) and is regular everywhere else. At infinity the function has a 
simple zero. A circular path enclosing the origin may alternatively be 
regarded as a circular contour enclosing the point at infinity. If these 
paths are separately traversed in their counterclockwise directions, the 
values of the resulting integrals are ±.2Trj respectively. Notwithstanding 
the fact that /(s) is regular at infinity, it is seen that the contour integral 
enclosing this ix)int has a nonzero value. 

Conversely, one cannot conclude that the integral has a nonzero value 
for a contour enclosing the point at infinity if the function there has a 
simple pole. For example, if /(s) = s, the contour integral evidently has 
the value zero. 

The residue of a function in the point at infinity cannot be evaluated 
by any of the processes which apply to finite points. One might suppose 
that such an evaluation could be accomplished through first introducing 
the change of variable indicated by the substitution f == 1/z, which inter¬ 
changes the origin with the point at infinity, and then proceeding in the 
normal fashion. Again the above example for the function /(s) = 1/2 
shows that this method is obviously incorrect. 

16. The partial fraction expansion of rational functions 

If /(s) is a rational function, then, as pointed out in Art. 13, it has a 
finite number of poles in the entire z-plane. This number, the pole at 
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infinity being excluded if present, may be denoted by n, and the rr-values 
corresponding to the poles oif{z) by Si, S 2 , * • * The principal parts of 
Laurent expansions for the function about the points Zi, S 2 , * • * are 
denoted by //i, A 2 , • • * hn respectively. The function 

/(s) - hi{z) - // 2 (s) - • • • - hniz) = gi,z) [209] 


must be an entire rational function, that is, a polynomial in z whose 
highest power equals the order of the pole of J(z) at infinity. This fact is 
recognized through observing, for example, that f{z) — //i(s) must be 
regular at the point z = Zi because its Laurent expansion about Z\ has 
no principal part and hence is a Taylor expansion. However, the function 
f{z) — //i(z) still has poles at the points Z 2 , zs, * * * Next, the function 
/(z) //i(z) — h 2 {z) is seen to be regular at the points Zi and Z 2 , and 
therefore has only the jioles at Z 3 , Z 4 , • • • z„, and so forth. 

Transposing the principal parts in Eq. 209 to the right-hand side, one 
obtains the representation 

/(z) = hi{z) -f h 2 {z) -p . . . -f hn{z) + g{z) [ 210 ] 


in which each term places one of the poles of/(z) in evidence. It is an 
explicit representation of the function in the form of a linear superposition 
of the individual contributions of its singularities. This representation 
for the function/(z) is known as its partial fraction expansion. 

More specifically, if 

rr \ __ <^0 4- OL\Z + Ol2Z^ + • • • + r91ll 

q{z) ~ ^0 + filZ -h ^ 

and it is assumed that all the roots of q{z) are distinct, all the poles of/(z) 
are simple. These roots may be denoted by Zi, Z 2 , • • • Zn- The principal 
parts of /(z) in its poles then have the form 

b 

h,{z) = -^=^— [ 212 ] 

Z — Zv 


in which are the corresponding residues. 

Applying Eq. 198 of the previous article, and noting that according 
to Eq. 195 0 (z) is in this example 0 = one finds 




p{z) 
dq ( 
dz 


[213] 


The derivative of q{z) for z — z, may be further evaluated through noting 
that the factored form of this polynomial reads 

g(z) = fin{z - Sl)(z - Z2) • • • (2 - Z„) 


[214] 



Art. 16] 


THE PARTIAL FRACTION EXPANSION 


309 


and hence that 



— 2i)(2j» 22 ) • • • {Zv Zv^i){Zy • • • (2|» — 2n) 


[215] 


which may alternatively be written 



[216] 


The way in which Eq. 215 is arrived at may readily be seen through 
first regarding q{z) in Eq. 214 as being in the form 

q{z) = (s - z,) ■ q*{z) [217] 

in which g*(z) is the right-hand side of Eq. 214 with the factor (2 — z.) 
missing. Now applying the rule for the derivative of a product to q{z) as 
represented in Eq. 217, one finds that 

+ [218] 

and hence that 


which agrees with Eqs. 215 and 216. 

In view of these considerations it becomes clear that the residues as 
given by Eq. 213 may alternatively be WTitten in the form 

= [(2 - Zv) •/(z)]*=*, [220] 

These results are unchanged if the polynomial q{z) has a zero root, that 
is, if = 0. They are restricted to the case of simf)le poles, of course, 
since the roots of q{z) are, in the above analysis, assumed to be distinct. 
When multiple roots occur, methods similar to those discussed in the 
previous article for evaluating residues at multiple-order poles must be 
used to determine the principal parts hy{z) in Eq. 210. 

If all the poles of f{z) are assumed to be simple, the results stated by 
Eqs. 212 and 220 determine the partial fraction expansion 210 except for 
the rational integral function g{z). This function is found from the form 
of f{z) given by Eq. 211 in the following way. li m ^ then f{z) is 
regular at infinity, and the entire rational function g{z) reduces to a 
constant. More specifically, if w = w, then 


«(z) 




whereas if w < n, then g(z) is identically zero. 


[ 221 ] 
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On the other hand lim > n and m — n — s, then f{z) has an 5 th order 
pole at infinity. 7'he function g{z) is found through dividing q{z) into 
p{z) by long division so as to get 

^ = 7.2* + 7.-12*“’ + • • • + 7i2 + 70 + [222] 

q{z) q{z) 

in which the remainder polynomial p*{z) has the degree n — 1. Then 

= To + TiS + * * • + 7 * 2 * [223] 

For m = n this process yields g(z) = jq = an//3n, whereas for m < n 
it is clear that g(z) = 0 as stated above. 

These considerations amount to putting/(s) into the form 

f(z) = g(s) += g(z) +/*(z) [224] 

in which/*(s) has a simple zero at infinity but contains the same p<iles 
as /(z) for the rest of the c-j)lane. In these polos/*(r) has the same jirin- 
cipal parts /i.(s) as the function /(z), and these principal parts are found 
according to Eqs. 212, 21.?, and 220 by use of either />(s) and /(z) or 
p*(z) and J*(z) in these expressions, whichever appear to be more ex¬ 
pedient. 

17. Multivalued functions; branch points and Riemann 

SURFACES 

A multivalued function with which the reader undoubtedly has some 
acquaintance is the logarithm.* This function is defined by the integral 

lnz = Xy [225] 

in which the path of integration in the f-plane extends from the point 
f = 1 to the point f = s, but otherwise remains arbitrary. The integrand 
is the function 

no - I [226] 

which is regular everywhere except at the origin (f = 0) where it has a 
simple pole with the residue unity. 

Hence the value of the integral is not affected by a deformation of the 
path of integration so long as no portion of this path is allowed to sweep 

’^Unless otherwise specified it is undentood that the natural logarithm is implied. This is 
denoted by In z to distinguish it from the Briggs logarithm, which is written log z. 
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across the origin. With reference to Fig. 16, one has 



in which the subscript 1 on the closed contour integral indicates that the 
origin is encircled once in the counterclockwise direction. From Art. 15 
it is seen that therefore 


JPI f JP2 f 


= lid 


[228] 



Fig. 16. The integral on closed 
path Pi-Pi yields 2t/ since the 
branch point at the origin is en¬ 
circled once in counterclockwise 
sense. 



Fig. 17. The integral on closed 
path P1-P2 again yields 2 ry. Path 
is different from that in Fig. 16 
but sense around branch point is 
the same. 


The same result is true for the two alternative paths shown in Fig. 17. 
In general, if the path Pi encircles the origin in the counterclockwise 
direction n more times than the path P 2 does, 



Hence if in conjunction with the definition 225 no statement is made 
relative to the path of integration, the value of the logarithm is deter¬ 
mined only within an arbitrary integer number of lirfs. Its multivalued¬ 
ness is thus apparent. 

This result is also readily obtained from the more familiar definition of 
the logarithm, according to which 

z = c*"* [230] 

If In z is here replaced by In z + Imj, the value of the exponential 
differs only by the factor which has the value unity. The view 

stated in the preceding paragraph, however, gives some pictorial signifi- 
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cance to this multivaluedness, whereas the more elementary reasoning 
precludes the possibility of such an interpretation. 

For further elucidation, the following 
more detailed representation is helpful. The 
complex number z is written in the polar 
form 

z — [231] 

As shown in Fig. 18, the path of integration 
is assumed to consist of the portion Li coin¬ 
cident with the real axis from 1 to r, followed 
by the portion L 2 , which is an arc drawn 
from the point r on the real axis to z. 

The variable of integration is also written 
in the polar form 

f = [232] 

whence 



Fig. 18. Integral of 1/s along 
L\ contributes to real part of 
logarithm; that along L 2 con¬ 
tributes to imaginary part. 




— dp+ —dd 

dp ae 


or 


Then 


d^ = + jpe^‘ do = (dp +jpdd)e^‘ 


dp 

— — \-jd9 

f P 


[233] 

[234] 

[235] 


The integral 225, separated into two parts corresponding respectively to 
the portions Li and L 2 of the resultant path of integration, reads 


Now 



[236] 


[237] 


is the logarithm of the magnitude of z, whereas 



[238] 


is the angle of z. Hence 

In z = In r + j<t> [239] 

The multivaluedness of the logarithm is seen to result from the addition 
or subtraction of an integer number of complete revolutions to the path 
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L 2 - This operation simply adds positive or negative integer multiples 
of 27r to the upper limit of the integral 238 and hence to <t> appearing in 
Eq. 239. Written in more complete form, this relation, therefore, reads 

In z = In r + + j2im [240] 

in which n is any positive or negative integer. 

For the detailed discussion of the multivalued character of the loga¬ 
rithm it is expedient to define the value of Eq. 240 for n = 0, namely, 

Ln z = In r+j<l> [241] 

as the principal value of In z, and write 

In 2 = Ln z -f jlirn [242] 

Ordinarily in speaking of the logarithm one has in mind the principal 
value only. 

Now that the multivalued character of the logarithm and the reasons 
for it are established, attention may be given to the question of how the 
ambiguity can be taken care of when this function enters into some 
problem, for example, in the consideration of the mapping of = In z 
in the w~ and z-planes. To a given point in the z-plane there correspond 
an infinite number of points in the z^^-plane, all of which have the same 
real part whereas their imaginary parts differ by multiples of 2t. 

Such a set of points in the 7£^-plane is presented in Fig. 19, which shows 
that the entire z-plane is mapped in any one of the oppositely cross- 
hatched strips, 2t units wide. Horizontal lines in the 2 £’-plane correspond 
to radial lines (0 == constant) in the z-plane; vertical lines in the zc^-plane 
correspond to concentric circles about the origin (r = constant) in the 
z-plane. The system of concentric circles and radial lines in the z-plane 
is, therefore, transformed into a rectangular grid in the 2 t»-plane. 

The fact that the locus joining a set of points in the zc»-plane corre¬ 
sponding to the same z-value (like the vertical dotted line in Fig. 19) 
becomes a circular locus in the z-plane which winds around and around 
the origin suggests that the multivaluedness may be eliminated artificially 
through conceiving the z-plane in the form of a winding surface comprising 
an infinite number of superimj^osed leaves which have a common central 
point at the origin and simulate a winding staircase of infinite width in 
which the steps are replaced by a smooth continuous ramp. As the slope 
of this winding surface is made smaller and smaller, the spacings between 
the leaves (or successive elevations of the ramp) ultimately become 
negligibly small. 

The one original z-value representing an infinite number of zc^-values 
differing hy j2Tn is now separated into a uniquely corresp)onding infinite 
number of z-values which lie directly above and below each other on the 
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various stages of the ramp or levels of the continuous winding surface. 
Each level, or leaf, of the surface carries one of the separate 2-values 
which now corresponds uniquely to one of the ^e^-values. To go from the 
2-value representing a given 2£;-value to that representing the value 
w ±:j 2 iry one must follow the ramp once around the origin in the counter¬ 
clockwise or clockwise direction respectively. The winding sense of the 
ramp is such that the increment in ze; is -\-j 2 ir for one revolution in the 

counterclockwise direction. 

This hypothetical surface which 
thus effectively renders the func¬ 
tion single-valued is a Riemann 
surface. The origin or common 
point about which the surface 
winds is called the winding point or 
branch point of the Riemann sur¬ 
face. It evidently is a singularity, 
for the logarithm function does not 
have a finite value there.* With 
the exception of this point and the 
one at infinity, the function = In 2 
is regular in the entire Riemann 
surface, and its integral around 
any closed contour is zero because 
it is impossible to wind about the origin in the same sense a nonzero 
number of times and return to a given starting point. 

The logarithm is an illustration of a multivalued transcendental 
function. The Riemann surface for such a function has an infinite number 
of leaves because the multivaluedness is infinite. The inverse trigonomet¬ 
ric functions tan”^ 2, sin""^ 2, cos“^ 2, etc., are other examples. 

A class of multivalued functions having a finite degree of multi¬ 
valuedness, and hence possessing Riemann surfaces with a finite number 
of leaves, is found in the algebraic functions.! A simple example is the 
function 



Fig. 19. Sections of the zi;-plane each 
of which corresponds to a leaf of the 
Riemann surface of In 2 in the 2-plane. 


W = V2 — 2 o 


[243] 


In view of the preceding discussion it is convenient to write this expression 
in the form 


w = 


^ 1 /2 Ln (»—*o)+i»n 


[244] 


*It should not be inferred that branch points necessarily are singularities of this kind. It is 
possible (as in the case of many algebraic functions) for the function to have a finite and 
unique value at a branch point. 

fNot all algebraic functions are necessarily multivalued. The rational functions, for 
example, are single-valued algebraic functions. 
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For a given value of s, this function has two values, one for n = 0 and 
the other for n = 1. For w = 2 the same value again obtains as for n = 0, 
and for w = 3 the {n = l)-value is repeated, etc. The Riemann surface 
for tliis function, therefore, has but two leaves. The branch point is 
located at z == Zq. 

The structure of the Riemann surface about z = Zq is similar to that 
of the logarithm function about its branch point, but the complete 
surface must now be so constructed that the same leaf is regained after 
two complete revolutions about the branch point. The first step toward 
clarifying this picture involves a recognition of the fact that the point at 
infinity has the same character as the point Zq. This circumstance is 
somewhat easier to see if the variable is changed by the transformation 


z' = 

[245] 

2 Zq 

Then Eqs. 243 and 244 become 


10 = ( 2 ')“*'* = 

[246] 


in which the point z' = 0 corresponds to z = <». 

Since the point at infinity must be included in the present visualization 
process, it may be a little easier if the z-plane is replaced by its associated 
com[)lex sphere. This sphere is imagined to have a double surface. Both 
surfaces are slit from the ix)int z == Zo to the point at infinity along a path 
which is arbitrary except that it shall have no crossover p)oints. Through¬ 
out the entire length of this cut, the top leaves of the double surface are 
now imagined to be joined to the bottom leaves on the opposite sides of 
the cut (a physical imix)ssibility, of course, but not beyond the powers 
of a good imagination) so that crossing the cut in either direction effects 
a transfer from the upper to the lower leaf of the Riemann surface or 
vice versa. This continuous duplex ramp is called a brajKh cut. 

The resulting duplex surface evidently has the properties required for 
the unique mapping of the function given by Eq. 243. The two z-values 
corresponding to the two zc^-values that differ by a factor lie above 
one another on the two leaves of the Riemann surface, and to go from 
one of these z-values to the other it is necessary to cross the branch cut 
and pass completely around either the branch point at z = Zq or that at 
2 = oc. The same z-value may be regained by passage around a branch 
point an even number of times. 

The function 

w = V(z — 2i)(z — Zz) • • • (z — Zk) [247] 

is also double-valued, and its Riemann surface again has two leaves. 
The branch points are ii, S 2 , • • • s*. For very large values of z the function 
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behaves like and hence it is clear that the point at infinity is also a 
branch point if k is odd. 

The branch cuts of the Riemann surface are made along paths joining 
the points Zi and S 2 , S 3 and S 4 , etc. These paths cannot have any crossover 
points. In particular, for k — 2 the branch points are z — Z\ and z = S2, 
which are joined by a branch cut in a manner exactly analogous to that 
discussed for the points z = Zo and s = 00 in the preceding example. 
In fact, the two-leaved Riemann surface for the function 247 with 
^ = 2 is in all respects similar to that for the function 243 except that the 
second branch point lies at a finite s-value. A closed path which encircles 
both branch points Zi and Z 2 remains on the same leaf of the Riemann 

surface; that is, a given point z on 
this closed path is regained after a 
single traversal. 

This situation may be clarified by 
reference to Fig. 20. A traversal en¬ 
closing both points Si and Z 2 which 
begins and ends at P must be equiva¬ 
lent to a traversal around the closed 
path Li followed by a traversal around 
the closed path 7 ^ 2 ? because the differ¬ 
ence amounts only to the traversal 
from P to ^ and back to P, around the 
shaded area which contains no branch 
point. Inasmuch as a separate traver¬ 
sal around Li or around L 2 effects a transition from one leaf of the 
Riemann surface to the other, it is clear that a given point traversing 
these two circuits in succession must return to the same leaf of the 
Riemann surface. 

Analogous reasoning shows that the cases k — 3 and k = A have 
similar Riemann surfaces. For k = A the finite point 24 replaces the 
branch point which for ^ = 3 occurs at infinity. The surface has two 
branch cuts, and a closed circuit which surrounds any two branch points 
returns to a given point after one traversal. The extension of this reason¬ 
ing to the interpretation of the two-leaved Riemann surfaces for larger 
values of k is straightforward. 

An extension of the same reasoning likewise leads to the required 
structure of the Riemann surface for the function 

w == ^z - Zo [248] 



Fig. 20. A point traversing L\ and 
L 2 in succession must return to the 
same leaf of the Riemann surface. 


or 


w 


~ Ln U-zo)-fi — 
m 


[249] 


This function is w-valued, has a branch point of the (m — l)th order 
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at the point z = So, and possesses a Riemann surface having m leaves. 
The point at infinity again has the same character as the point z = Zof 
and these two points are joined by a slightly more complicated branch 
cut. At this branch cut the top leaf of the Riemann surface is joined to 
the one located below it on the opposite side of the cut, whereas the 
second leaf on the original side is joined to the third leaf from the top on 
the opposite side, etc. Finally, the bottom-most leaf on the original side 
of the cut is joined to the top leaf on the opposite side. The result is that 
a path must encircle either branch point m times before a given point 
on one of the leaves can be regained. 

It may be useful to observe that the function w = has a Riemann 
surface entirely similar in its structure to that of the function w = In z 
except that the latter has an infinite number of leaves. The branch cut 
in the case of the function w = is a necessary concept only because 
some mechanism must be imagined whereby the bottom leaf rejoins the 
top leaf of the surface. Actually leaving this mechanism entirely to the 
imagination is more effective than tiydng to formulate some sort of 
piecing and pasting process between the leaves which must afterward 
be apologized for because of the mechanical impossibility of carrying out 
such a scheme in a physical model. 

A mathematician prefers not to be annoyed with the physical difficulties 
involved in the visuali.^.ation of a branch cut, the more so since it implies 
the existence of a definite path along which the passage from one leaf to 
another takes place. According to the true conception of a Riemann 
surface, such passage is not to be regarded as localized in a branch cut. 
Rather, one is to regard the invention of a branch cut as made necessary 
only by reason of the inadequacy of one’s habitual conception of space to 
comprehend the mechanism of the Riemann surface. 

In the function w = In z this difficulty does not appear, but it is 
replaced by the equally difficult conception of an infinite number of 
leaves in the Riemann surface. In terms of the complex sphere associated 
with the s-plane, the south jx)le (origin) and the north pole (infinity) are 
branch points of infinite order. The Riemann surface is a continuous 
succession of spherical shells winding round and round a polar axis, 
somewhat on the order of a snail’s shell only that the winding pitch is 
zero and the number of revolutions infinite. The surface for the function 
•w = Vz has the same structure but comprises only m revolutions, after 
which identity with the original leaf is again established. 

18. Algebraic functions; more about the classification of 

FUNCTIONS 

From the discussion just given it is clear that if the function w = /(s) 
has a branch point of the (w — l)th order in s = Zq, then, by use of the 
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substitution 


2 — 2 o = 

[250] 

one may study the function 


/(z) =/(zo + re’*) 

[251] 


for an appropriate value of r on the various leaves of its Riemann surface 
through letting </> vary continuously from some initial value </>□ to a final 
value 4>q + 2imr., K further increase in 4> will merely yield the same values 
over again. 

The m leaves of the Riemann surface for this vicinity of the point 
Zo are encountered in cyclic order in the intervals 

4 >o + 2{v — l)ir < <^ < 00 + 2yTr [252] 

with V = 1, 2, • • • w. 

The w-values of the multivalued function f(z) may correspondingly 
be denoted by 

W, = /(2o + [253] 

with 00 < 0 < + 2x. 

The quantities wi, W2y * • • Wm which represent the function on the 
various leaves of its Riemann surface, are called the branches of the 
function/(s). They evidently form a cyclic group, since, for the interval 
00 + 27 r < 0 < 00 + 4 Tr, for example, Wi replaces ^^'2 replaces W:u 
and so forth, and Wm replaces wi. 

In terms of these branches of the function w = /(s), an important 
property of the branch point of finite order may now be stated, namely, 
that the same limiting value of the function results for the limit z—^Zq 
regardless of which one of the branches Wi, W 2 ^ • ' ’ etc., is chosen in the 
process of evaluating this limit. In other words, the value of f{z) in the 
branch point may be approached from any one of the m leaves of the 
Riemann surface. Since the branch point thus yields a unique value for 
the function, it may be included as a point of this surface. 

It is possible for a multivalued function to have this character in the 
vicinity of a point z — Zq and there possess an infinite or finite value, 
either of which is definitely determinable. A singularity of this sort has a 
more general character than that of either a branch point or an ordinary 
pole, since it embraces both these as special cases. It is called an algebraic 
singularity inasmuch as it represents the only kind of singularity found 
in that class of functions known as the algebraic functions. 

In order to study the behavior of an m-valued function in the vicinity 
of an algebraic singularity at the point z = Zo, one may make the change 
of variable indicated by 

/ = (s - [254] 
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Then 

w = /(z) = ^(/) [255] 

becomes a single-valued function of the complex variable i, since the 
latter has taken over the w-valued character in terms of the original 
variable z. If the function possesses an «th order pole at the point 
t = 0 (corresponding to z = zq) then, for the vicinity of this point, it 
may be represented by a Laurent expansion whose descending part 
contains n terms. Hence it becomes clear that the function /(z) admits 
the following expansion in the vicinity of an algebraic singularity: 

f(z) = £ C(z - Zo)"'™ [256] 

y =» —n 

This singularity is an ordinary pole of the nth order for the function/(z) 
if = 1. It represents an ordinary branch point of the (m — l)th order 
if n = 0 . 

In general, that is for w > 1 and w > 0, the function /(z) is said to 
possess a singularity at the point z = z© which is simultaneously a pole 
of the order n and a branch point of the order wi — 1. For example, the 
function/(z) = Vz has a branch point of order 1 at z = 0 , whereas at 
z == 00 it has simultaneously a simple pole and a branch point of order 1 . 
The same statement, with an interchange of reference to the points z = 0 
and z = 00 , applies to the function/(z) = 1/v'z. If n is inlinite, the func¬ 
tion has an essential singularity at the branch point of order m — 1. On 
the other hand, if m is infinite, the function is said to have a logarithmic 
branch point (it is then no longer an algebraic function, for the latter can 
have branch points of finite order only). 

Algebraic functions are defined as functions possessing only a finite 
number of algebraic singularities. If the function is m-valued, it is not 
necessary that all or that even one of its singularities also be a branch 
point of the order {m — 1 ), but a sufficient number of these singularities 
must be branch points of such order and distribution as will insure that 
the m leaves of the associated Riemann surface form a connected system. 
For any nonsingular z-value the function /(z) possesses the w-values 
indicated by 

/(z) ^ Wi, 1V2, ■ ■ ■ -Wm [257] 

which represent the function on the correspondingly numbered leaves of 
its Riemann surface. In terms of these branches of the function/(z) one 
may form the system of symmetrical functions 

fl(z) = -t- Wz + • • • + «'l» 

^ 2 ( 2 ) = WiWi •+• WiWz + • ’ • + 


^m(z) = «'1«'2 • • • Wm 


[258] 
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In view of the fact that the branches Wi, W 2 y * * * form a cyclic group, 
it follows that all the symmetrical functions ypoy * * • are single- 
valued. That is, as the point z is allowed to move along any path on the 
Riemami surface, avoiding only the singularities of /(s), the functions 
zc>i, Woj • • ' Wm can merely interchange their identities, and since the 
functions ^ 2 ? • • • are given by symmetrical combinations of the 
elements U'l, U' 2 , • • -Wmy they are not affected by such interchanges. 
Furthermore, they can have only algebraic singularities because this is 
the only kind that the branches Wiy possess, and the are 

formed from the w's by the processes of addition and multiplication alone. 
Algebraic singularities in the case of single-valued functions, however, 
must be ordinary poles. Hence the functions ypi(z)j ^ 2 ( 2 )? * * • ^m{z) must 
be rational. 

Now it is to be recalled from the theory of algebraic equations that the 
symmetrical functions defined by Eq. 258 satisfy the equation 

{w -- Wi){w -- W2) • • • (zc; Wrn) 

- Mz) * + * • • + = 0 [259] 

It is also recognized that the functions 258 have a common denominator 
equal to the product of the denominators of the branches W 2 y * * * 
and that this common denominator must be a rational entire function 
of 2 , from the last of Eqs. 258, or alternately because the branches Wi^ 
W 2 j ' ' ' Wm individually are single-valued on their respective leaves of the 
Riemann surface and there possess singularities which, therefore, can be 
none other than ordinary poles. Multiplying Eq. 259 by this rational 
entire function, which is a finite polynomial poiz), one finds 

F{z,w) = Poiz) • + p,{z) . + • • • + Pm{z) = 0 [260] 

in which po, pi, • pm are finite polynomials in z. 

The algebraic functions w = f{z) are thus seen to be defined as the roots 
of an algebraic equation whose coefficients are ordinary polynomials in 2 . 
More precisely, the roots are the branches which collectively define a 
single algebraic function on the various leaves of its Riemann surface. 
The function F{z,w) may never be reducible to the product of two or more 
factors having the same form as F{z,w), since the vanishing of any factor 
alone would then satisfy Eq. 260, and hence several independent functions 
rather than a single one would be defined by this equation. 

The branch points occur for those values of z for which Eq. 260 has 
coincident zc^-roots. The coincidence of roots requires that the discriminant 
be zero; and since this discriminant is a rational function of the poly¬ 
nomials ply pm and hence a rational function of z, it cannot vanish 
dentically, but can do so only for a finite number of z-values. Hence 
the number of branch points of the algebraic function defined by Eq. 260 
is finite. 
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The engineering student will find it helpful to visualize the Riemann 
surface as a set of m parallel metal sheets and the branch points as spot 
wx‘lds which join two or more of the sheets at isolated points. The dis¬ 
tribution of these spot welds and the number of sheets held together by 
each must evidently be such that the m sheets are connected; otherwise 
instead of a single w-valued function, several functions of lesser order 
than m are defined. 

The classification of functions in terms of the nature and distribution 
of their singularities, which is partially discussed in Art. 13, may now be 
viewed in a more thorough fashion. All analytic functions may be divided 
into two main classes, which are the algebraic and the transcendental. 
In other words, any function which is not algebraic belongs to the 
transcendental group, comprising single- or multivalued functions having 
essential singularities. Algebraic functions, on the other hand, may be 
further subdivided into single-valued and multivalued functions. The 
single-v^alued ones are identified with the rational functions, which 
include some of the entire functions, namely, the finite polynomials. 
The meromorphic functions, which are single-valued and may have any 
kind of singularity at infinity but must have only poles in the finite 
2 -plane, include some of the functions in the transcendental group and 
all the functions in the rational group. The entire functions may likewise 
be regarded as a subclass in the transcendental group, but in addition 
they lay claim to some of the functions in the rational group. The follow¬ 
ing block diagram is intended to unify these remarks. 



It is now possible to discuss somewhat more adequately the inversion 
of functions (which is introduced in Art. 3) with particular reference to 
the vicinity of saddle points described in Art. 14, Suppose a given single 
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valued function -w = J{z) has, at a point 2 = So, vanishing first and higher 
derivatives up to but not including the »th. For the vicinity of this point 
it then possesses the Taylor expansion 

w = li',, + (2 — 20 )" + a„+i (s — 4- * • • [261] 

with a„ 7 ^ 0. Writing this equation in the form 

= (2 - 2„)" + ^ (2 - 20 )"+^ + .. • [262] 

(In (^n 

extrac ting the wth roc^t, and introducing for abbreviation the variable 



one may put the series 262 into the form 

r = (2 - 2o) {l + (2 - 2o) + ^ (2 - 2 o)2 + • • • [264] 

I J 

The bracketed expression, inclusive of the exponent l/;i, may for the 
vicinity of the point s ::o (which is not a branch point) be expanded 
in a Taylor series having the form 

1 + /)] (2 — 2o) + to(2 "())*' + • • • [265] 

This Taylor scries represents the bracket function in Eq. 264 on only 
one of the leaves of its Riemann surface. The corresponding representa¬ 
tions on the remaining n — 1 leaves of this surfac e, however, differ from 
265 only by the factor 

for = 1, 2, • • • « - 1 [266] 

Substituting 265 for the bracket expression in Eq. 264 yields 

T = (s ~ Zq) + bi {z ~ So)" + toCs — ' Zq)^ -P . . . [267] 

which, on the particular leaf of the Riemann surface in cjuestion, is a 
unique representation for t(s) in the vicinity of the {X)int z = So. Hence, 
according to the discussion in Art. 3, it possesses an inverse function 
whose Taylor series for the vicinity of r == 0 (wliich is a regular point) 
has the form 

(2-2o) = /3,t + (8ot2 + /33t3 + ... [268] 

The coefficients in this series for the inverse function may, for example, 
be found through first substituting the series for (2 — 20 ) into Eq. 267 
and, after arrangement in ascending powers of t, obtaining 

T 0iT + + (2bi^iff2 + ^201 + + • • • [269] 
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whence, equating coefficients of like powers of r, one has 

Pi = 1 , 

^2 = -bi, [270] 

Pa ~ 26 i^ — 62 


Substitution of the expression 263 for t into Eq. 268 then gives 

/-W — K’oV^" a /W — ~ 


[271] 


which is a representation for the inverse function s = ii>{w) for the vicinity 
of the point w == corresponding to the point z = Zq. Equation 271 
may be written 

s = + Ci{w - + Coiw - “H * * * [272] 

This, however, is recognized (according to the discussion leading to Eq. 
256) as the expansion of an ;/-valued function in the vicinity of a branch 
point of the {n — l)lh order at the j)oint ~ c*^o- Hence it is established 
that if a given function w ~ f{z) has a saddle ix)int of the (n — l)th 
order at a point z = Zq, the inverse function c = <^)(u:') has a branch px)int 
of the (n — 1 )th order in the corresixniding point iv = If the rx>int 
z — Z() is a zero of the ;/th order for the function w = /(s), the above 
analysis remains unaltered except that becomes zero. The inverse 
function s — then has a branch point of the {n — l)th order at the 
origin in the 7t'-j)lane instead of at the point iv — 


19. A TimOREM REGARDING THE NUMBER OF ZEROS AND POLES 
WITHIN A GIVTCN REGION; THE FUNDAMENTAL LAW OF ALGEBRA 

A given function w == f(z) is assumed to have a zero of the order a 
in the point z - So- The Taylor expansion about this point then reads 

f{z) = a^{z - ::o)" + ~ + • • • [273] 

and the derivative of J{z) is given by 

f {z) = OtOaiz — + (« + l)^a+l (2 Sq)^ -f- * . . [274] 

Dividing the series 273 into the series 274 by long division gives 

—— = a{z — So) ^ + ^^0 + ^ 1 ( 2 ? — 2()) + ^ 2(2 — So)^ 4- . .. [275] 

y W 

This function, therefore, is seen to have a pole of the first order in the 
point z Zo with the residue a. 

Alternatively, let it be supposed that the given function fyz) has a pole 
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in z* of the order /3. Then its Laurent expansion about this point is given 
by 

/(z) = b-piz - z*)-^ + (z - + • • • [276] 

and the derivative reads 

/'(z) = - z*)-^^ - (fi- + . • • [277] 

By long divasion it is then found that 

= “/3(z — 2*)~^ do -{• d\{z — z*) + dzCz — jf')* -f- ... [278] 

/( 2 ) 

from which this function is seen to have a simple pole in the point z = z* 
with the residue —/3. 

According to the residue theorem it follows from these considerations 
that 

P79] 

where the path C is assumed to enclose no other zeros or poles of the 
function/(z) except those at the points Zo and z*. 

In general it is seen that if the path C encloses zeros of /(z) having 


the orders ai, oi 2 , • 

• • a*, and poles having the orders 

■ • 0,, and if 


«1 + «2 + • * ' + ^ 

[280] 

and 

01 + /Sz + • • • + ^» = 

[281] 

then 

^ f dz = N -P 

2irjJc f(z) 

[282] 


The integer N is equal to the total number of enclosed zeros of the func¬ 
tion /(z), each one being counted as often as its order requires; the integer 
P is equal to the total number of enclosed poles of the function /(z), 
each one likewise being counted as often as its order requires. The result 
given by Eq. 282 states that the contour integral formed for the ratio 
f /f, when multiplied by l/litj, is equal to the total number of enclosed 
zeros of the function /(z) diminished by the total number of enclosed 
poles, each of these being counted as often as its order requires. 

An application of this result to a special case is of particular interest. 
Here the function /(z) is assumed to be the finite polynomial 

/(z) = Z” -f- 12"~^ + • • • -f CliZ -f do 


[283] 
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Then 


/(g) ^ ^ + (n - l)an^iz^ ^ + - - + 

f{z) + ^n—ig” ^ -f- . . . -j- aiZ + Gq 


[284] 


Dividing the denominator into the numerator by long division, one obtains 
a series of the form 


J{z) Z 7? 


[285] 


which converges only for s-values lying outside a circle enclosing all the 
zeros of the function/(s). In the region outside this circle it represents the 
Laurent expansion for the function f{z)/f{z), whence the integer n 
is recognized to be equal to the sum of the residues of this function in 
its poles, all of which are located within the circle. Consequently, if C 
denotes this circular contour, then 


J.. ffJA = 

Iwj Jc fiz) 


[286] 


Inasmuch as the function/(::), given by Eq. 283, has no poles inside the 
contour C, the conclusion follows that the highest power ft of the poly¬ 
nomial 283 equals the total number of roots of the algebraic equation 
f{z) ~ 0. This is the familiar fundamental laia of algebra. 


20. A METHOD FOR THE DETECTION OF ZEROS WITHIN A GIVEN 
REGION 


Another useful opjiliealion of the result stated by Eq. 282 in Art. 19 
is the following. If a given function = /(c) is known to have only zeros 
within a region enclosed by the contour C\ then 


fiz) 


Ittj Jc I 


dz = N 


[287] 


equals the number of enclosed zeros. According to the principles of con¬ 
formal mapping, the contour (' in the c-pIanc detenniiu‘s an equivalent 
contour in the Tc’-j)lane. dlie integral 287 may corresi.K>ndinglv be replaced 
by 



vV 


[288] 


in which D is a closed contour in the E'-jilane corresponding to the path 
(’ in the ;s-j)lane. From the discussion of the logarithm function in Art. 
17, it is recognized that the integi^r A’ in Eq. 288 must equal the number 
of times that the contour D in the Tc-plane encircles the origin. If this 
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contour encircles the origin more than once — that is, if > 1 — it is 
clear that the inverse of the function lv = f{z), namely, z — is 

multivalued, and that its Ricmann surface in the ic-plane has such a 
structure that a path corresponding to C in the s-plane closes upon itself 
after N complete circuits around the origin in the xc-plane. 

The contour C may be located anywhere in the j^-plane. The conclusion 
to be drawn is that the number of zeros oifiz) enclosed l)y (each being 
counted as often as its order requires) is given by the number of times 
that the corresponding closed contour D encircles the origin in the zc-plane. 
If the closed contour D (which may, when plotted in the simple 7c-plane, 
be any closed curve with or without crossover points) does not encircle 
the origin in the 2 c»-plane, the given function/(c) cannot possess any zeros 
within the region enclosed by C, Hence if it is to be established whether 
a given function/(c) possesses zeros within a stated region, the question 
may be answered through mapping in the ic'-plane the locus corresjx)nding 
to a boundary enclosing the stated region in the c-plane, and noting 
whether this closed locus in the ze~plane docs or does not encircle the 
origin. 

It is, of course, necessary to know that /(s) does not hav'e poles 
within the region in question. The method is evidently also applicable 
to the determination of the presence of poles within a given region if 
the function is known to hav^e no zeros there. In eitlier case, obviously, 
neither zeros nor poles should lie upon the contour C. 

In applying the method to practical problems it is helpful to note the 
significance of several detailed characteristics which the contour D may 
exhibit. The contour C is assumed to enclo.se a simply coniKH ted region 
in the c-plane. If this region contains neither zeros nor poles, the cor¬ 
responding contour D in the 2 ^^-plane, as stated above, does not enclose 
the origin; this characteristic of the contour D, however, may not always 
be immediately evident. The inverse function c = <j>{w), except in trivial 
cases, is multivalued, and hence the region enclosed by the contour D 
may have overlapping portions which actually, of course, lie on separate 
leaves of the associated Riemann surface. Thus, if the region enclosed 
by the contour C contains saddle points (see Art. 14), the contour/^ 
encloses the corresponding branch points, and hence makes several com¬ 
plete circuitations about portions of the region enclosed by it. One 
readily appreciates, therefore, that the contour D may be a rather 
tortuous path even though the contour C is a simple one. It is possible for 
the region enclosed by the contour D to surround the origin completely 
and yet not contain the origin. 

The closed contour C is ordinarily assumed to be traversed in the 
counterclockwise direction, and the region enclosed by it is taken to be 
that on the left of this contour. The corresponding direction of traversal 



Ari, 2/] THE PRINCIPLE OF THE MAXIMUM MODULUS 


327 


for the contour D may always he established through considering any 
two neighboring points on C and determining the corresponding neighbor¬ 
ing points on D, According to the principles of conformal mapping, the 
region enclosed by D lies to the left of this contour, but this observation 
alone is frequently insufficient to enable one to tell by inspection whether 
the enclosed region contains the origin, and if so, how many times the 
contour D encircles the origin. 

A method for the correct evaluation of this situation is the following. 
One imagines a radius vector extending from the origin of the ze^-plane 
to a variable point w on D corresponding to the variable point z on C. 
As z traverses C and w traverses />>, this radius vector changes in length 
and in its angular position. For a complete traversal of s around C, the 
net change in the angle of the radius vector must obviously equal an 
integer number of 2t radians fa change is positive if it corresfx^nds to 
rotation in the counterclockwise direction). T he value of this integer 
ecpials the number of times that the contour D encircles the origin. 

If the function w — J(z) is analytic within the region enclosed by C, 
this integer cannot be negative, but it can become negative if the region 
also contains poles. T'or example, suppose f{z) = \/z and let C be any 
contour enclosing the origin in the s-plane. Then it is clear that the integer 
in ciuestion equals — 1. One may say that the contour D in this case 
encloses the [XDint at infinity in the ^t^-planc. If C is the unit circle, in 
this simple example D is likev/ise a unit circle. The enclosed region in 
the s-plane is that within the unit circle; the enclosed region in the x^^'-plane 
is that lying outside the unit circle. The requirement that the function 
fiz) be known to have no poles (or other singularities) within the region 
enclosed by C is again recognized as being necessary, since the presence 
of a pole cancels the effect of a zero as far as the net value of the integer 
is concerned. 

21. The PRiNeiPLE of the maximum modulus; Rouche's theorem 
AND Schwarz'S lemm^ 

To continue the considerations of the previous article, if the function 
f{z) is analytic on C and within the region enclosed by it, and if on 
this contour |/(:;)| g M (some real positive quantity), it follows that 
the contour D and its enclosed region must lie within (or be tangent to) 
a circle of radius M concentric with the origin of the tc^-plane. This fact 
is clear from the consideration that the region enclosed by D cannot 
extend beyond a boundary formed by those confluent segments of the 
contour D which are farthest (but still at a finite distance) from the origin; 
otherwise the point at infinity would be contained within the region, 
thus contradicting the assumption that /(s) is analytic within C. Since 
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every point within the region enclosed by C yields a point in the w-plane 
which lies within the region enclosed by it follows that |/(2)| ^ M 
for all points within C. Moreover, the equality sign in this relationship 
holds only if the region enclosed by D consists of a single point, in which 
case it holds identically, for then f{z) must reduce to the constant M, 
This result is known as the principle of the maximum modulus. It may 
readily be demonstrated analytically with the help of Cauchy's integral 
formula, Eq. 80. The closed contour S (upon and within which f{z) is 
analytic) is identified with a circle of radius p about some finite point z. 
Then 


and 


Hence one has 


• — 2 = pe^* 

[289] 

/(f) =f(z + pe^*) 

[290] 


[291] 

/(z) = ^ 

[292] 


from which the value of the function at the center of the circular region 
is seen to equal the arithmetic mean of its values on the boundary. 

Since the mean of a set of complex values must be less than or at most 
equal to the mean formed from the magnitudes of these values, it follows 
that the magnitude of f{z) must, surely be less than or at most equal to 
the largest value which the magnitude of the function assumes on the 
circular boundary. That is, if M is the maximum value of l/(f)| the 
boundary, | /(s) | ^ M, 

This result may be generalized to the extent that the boundary need 
not be circular and the point z may be any internal point. For if the result 
were not also true in this more general case — that is, if the maximum of 
the absolute value of the function did not occur on the boundary but at 
an internal point — by applying the specialized result to an appropriately 
chosen small circle about this internal point, one would clearly encounter 
a contradiction. This line of thought also shows at once that the equality 
of 1 /( 2 ) I and M can hold only if it holds identically, that is, if f(z) equals 
the constant M. 

If the function/(s) has no zeros (as well as no poles) upon or within 
the closed contour, by applying the same reasoning to the reciprocal 
function l/f(z), one recognizes that both the minimum and the maximum 
values of \f{z)\ on the boundary are minima and maxima for the enclosed 
region. 
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An alternative proof, which is collaterally interesting, begins with the 
result expressed by Eq. 287 of the previous article. The function /(z) is 
analytic upon C and within the region enclosed by this contour. A second 
function g{z), in addition to satisfying the same analyticity conditions, 
fulfills the relation 

k(z)l < \m\ [293] 

on the boundary C. On this boundary one, therefore, has 



[294] 


and hence the closed contour for the function 



in the tc^-plane, corresponding to the contour C in the 2-plane, clearly 
cannot enclose the point w = 0. According to the discussion in Art. 20, 
therefore, one has 



[296] 


Using Eq. 295, one now finds 

^ = /• d(/+ ^) - (/+ g) -df ^ d{f A- g) _ ^ 

w fif + s) f + g f 


[297] 


Hence in view of Eq. 296, the result expressed by Eq. 287 gives 


_JL = .J_ ^ 

2itjJc f + g IvjJc f 


[298] 


from which it may be concluded that, under the conditions stated above, 
the function/(z) + g(z) has the same number of zeros within the region 
enclosed by C as does the function /{z). 

In terms of this result (known as Roudte's theorem), the principle of 
the maximum modulus is easily proved. Suppose the maximum of 
|/(z)l did not occur on the boundary C but at some internal point Zo- 
Then on the boundary one would have 



[299] 


and hence one could conclude that the function [l//(zo) — l//(z)] has 
the same number of zeros within the region enclosed by C as does the 
function l//(s). The latter has no zeros within this region because/(z) is 
analytic there, and the function [l//(2o) — l//( 2 )] has at least one zero 
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within the region, namely the one for z = sq. The supposition is, there¬ 
fore, untenable. 

A more specialized result is obtained if one considers the function/(z) 
to be analytic within a circle of radius R about the origin and to equal 
zero at the origin. It then possesses the Maclaurin series 

/(z) = Ojz -|- a^z^ -|- •+*••• [300] 

from which it is clear that the function 

[301] 

z 

likewise is analytic within the circle of radius R. If on the circular bound¬ 
ary it is known that 

1/(S)1 ^ M [302] 

then it follows that there 

M 

kWl S j [303] 

and, according to the principle of the ma.ximum modulus, that the 
magnitude of <t>{z) is less than (or at most equal to) M/R for all points 
within the circle. Hence one has the result that 

l/(s)| [304] 

for all points within the circle, and the equality can hold only if it holds 
identically, in which case/(z) reduces to a complex constant with the 
magnitude M/R, multiplied by z. 

This particular result is known as Schwarz's lemma. It has numerous 
practical applications in problems involving conformal mapping.* 

22. Some useful correlations with potential theory; 

Poisson’s integrals and Hilbert transiorms 

In Art. 5 it is pointed out that the real and imaginary parts u and v 
of a function of a complex variable may be interpreted physically as 
being two-dimensional potential functions. Any two functions of the 
variables x and y which satisfy the Cauchy-Riemann Eqs. 12 and 13 are 
said to be conjugate potential functions. Since Eqs. 12 and 13 become 
interchanged when « is replaced by v and v by —it is clear that the 
identities of these two functions become interchanged when the algebraic 

•An application of this sort is discussed in Art. 27. 
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sign of one of them is reversed. In the present article the properties of 
these functions are investigated in more detail. 

The point of departure in these discussions is the Cauchy integral 
formula, Eq. 80. A given function/(s) is assumed to be regular within the 
region enclosed by the circle shown in Fig. 21 as well as on this boundary. 
If f denotes any point on the circle and z is any internal point, 



Fig. 21. Change of variable relevant to the derivation of Poisson’s integrals. 


If, in this integral, z is replaced by some point s* external to the circle, 
the integrand is regular for all points enclosed by the contour C, and 
according to the residue theorem or Cauchy’s integral law, the value of 
the integral is zero. ITiat is, 


The point z* is now so chosen that 

= M! = £l 

" s s 


[307] 


in which the bar indicates the conjugate value.* Using this relation, one 
finds 


1 1 

■■■■ i ^ = 

f - 2 f - 2* 


If r 

fir - 



■= ± 
Z 


[308] 


*The point s* thus determined is called the image of the point z with respect to the circle. 
The two points z and z* are geometrically related as shown in Fig. 21. This item is discussed 
in Art. 24. 
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Addition or subtraction of Eqs. 305 and 306 is then seen to yield 

/W - ±/(0) + ^ m f [309] 

in which Eq. 305 is also used to obtain the particular relation 


Since, according to the notation given in Fig. 21, 

2 = re^* 


and 

f = 

one has 

f - 2 “ Rc^'^ - re^'>‘ ~ R^ + - 2rR cos -'7) 


[310] 

[311] 

[312] 

[313] 


Hence 

i _ f_ ^ _ —; 2rR si n (j - (/») 

f — 2 f — 2 R‘ + r — 2rR cos — 0) 

and 


r ? _ 2R^-2rRcos(^p-<t,) _ R^-r^ 

f—2 f—2 R^+r'^— 2rR COS (\p — <t>) R^+r^ — 2r cos (^~4>) 

Equation 312 is used to obtain 



[314] 


[315] 


[316] 


Substituting these results into Eq. .309, one obtains the following 
integral representations: 


and 


1 

- tJ 


^+t 

R^ - r~ 


R^ + r~ — 2rR cos {ij/ — <^) 


(v£—0)- 

[318] 


It is useful to observe that the quantity rR sin — <i>) represents the 
area of the parallelogram determined by the vectors f and z and that 

/?^ + — 2rR cos — <l>) = — 2 p [319] 
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is the square of the distance between the points f and 2 . It may, therefore, 
be concluded that the formulas given by Eqs. 317 and 318 are independent 
of the location of the center of the circle C, although in the above deriva¬ 
tion the center is for convenience chosen to coincide with the origin of 
the 2 -plane. 

If the function /( 2 ) is written more explicitly as 

/(z) = u(r,<f>) [320] 

and Eqs. 317 and 318 are separated into their real and imaginary parts, 
one obtains the following two pairs of relations respectively: 

„(,,*) - .( 0 ) + ^ 

»(r,») - »(0) - — i'" di, [322] 

and 

^ dyp [323] 

‘hr 

in which the relation 319 is used for the sake of abbreviation. It is ob¬ 
served that the formulas in each pair become interchanged when u is 
replaced by v and by —u. 

The results expressed by Eqs. 321 and 322 show that the real and 
imaginary parts, u and v, of a function of a complex variable are, except 
for an additive constant, explicitly related to each other. The real part 
determines the imaginary part, or vice versa. Hence, given either part, 
the corresponding complex function may be found. The formulas 321 
and 322 are said to yield the conjugate potential function to any given 
jx)tential function or to transform one such function into its conjugate 
mate. In this sense they are sometimes referred to as a pair of transforms. 

The integrals 323 and 324 likewise form a pair, but they do not ex¬ 
press one pKDtential function in terms of the other. Instead, they yield 
the real and imaginary parts of a complex function at any point within 
the given circle in terms of their respective values on the boundary. If a 
potential function is known to be regular for all points on a circular 
boundary and within the enclosed region, it is there uniquely determined 
in terms of its boundary values by means of the formula 323 or 324. 

For r = 0, these integrals yield 

«(0) = ^ j(* 


[ 325 ] 
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and 


V(P)=~-£\{R,i)drP 


[326] 


These results state that the value of either potential function at the 
center of the circle is equal to the average of its values on the circular 
boundary. As a consequence it follows that the largest and smallest of 
the values which u and v assume throughout a circular regularity region 
must occur on the boundary of that region, for if such an extremum 
occurred at some internal point, the conditions stated by Eqs. 325 and 
326 could not be fulfilled for a small circle with its center at this point and 
its boundary within the original one. 

These conclusions yield a useful theorem to the effect that if a function 
of a complex variable is regular over a given region, the maximum and 
minimum values of its real and imaginary parts must for that region occur 
on the boundary.* The region evidently is not restricted to be circular in 
form since the above reasoning is equally applicable when the boundary 
of the regularity region is arbitrary. 

The formulas 321, 322, 323, and 324 are known as Poisson’s integrals. 
By a combination of Eqs. 322 and 323 a further result of practical utility 
is obtained. The first step is to form 


«(>■,<#>) 


+ 27X 


> 2 . R2 - ^2 - jirR sin - ,A) 


[ 327 ] 


From Eqs. 311 and 312 it is seen that 

r + 2 _ + re^^ - r~ - jlrR sin {4^-^) 

r - 2 Ri:^ - re^^ R^ + r^ - 2rk cos - 4 >) 

so that Eq. 327 may be written 

fir,<t>) =jv(0) + -^£ y^^u{R, 4>) dyp [329] 


By means of the series representation 


r + 2 
f - a 


= 1 




[330] 


♦This result, although similar to that stated by the principle of the maximum modulus, 
sh ould not be confused with the latter. As pointed out in the previous article, the modulus 
-f attains its minimum as well as its maximum value on the boundary of the region 
of analyticity only if the function has no zeros within this region. That is, if the function has 
zeros there, the modulus attains its maximum value, but not its minimum value, on the 
boundary. 
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and Eq. 325, this result may be rewritten in the form 

/(r,«) = /(O) + + p + • • •) [331] 

1 21 

~ < 1, SO that the in¬ 
tegration in Eq. 331 may be carried out term by term. When this is done, 
with 


a„ = ^ d4> [332] 

TT «/0 

it is seen that the result given by Eq. 329 may be expressed in the alterna¬ 
tive form 

Ji.r,<i>) = m + (0"[333] 



Fig. 22. Limiting process wliich converts Poisson’s integrals into Hilbert transforms. 

By means of either Eq. 329 or Eq. 333, the comple.x function is deter¬ 
mined within the circular region in terms of the values of its real part on 
the boundary. 

Other forms for some of these results, more appropriate to the condi¬ 
tions encountered in electric circuit theory, are obtained through assum¬ 
ing that the circle in the preceding derivations is an extremely large one 
lying in the right half of the s-plane, tangent to the y-axis at the origin. 
If this circle is imagined to become infmite in diameter, the entire right 
half plane will constitute the enclosed region and the imaginary axis 
(or y-axis) w'ill become the boundary, which then closes upon itself by 
passing through the point at infinity. The manner in which the integrals 
317 and 318 are to be interpreted in this limiting case is clarified some¬ 
what when the situation is pictured in Fig. 22. The center of the circle of 
Fig. 21 is imagined to lie on the real axis at a point infinitely far to the 
right. The point f, which in Fig. 21 is a point on the circular boundary, 
becomes the point jr\ on the imaginary axis, and the point z is character- 






336 


FUNCTIONS OF A COMPLEX VARIABLE 


ICh. VI 


ized in terms of the variables x and y of the plane of Fig. 22 as the point 
X + jy. 

In order to evaluate the forms which the integrals 317 and 318 assume 
when this limiting process is carried out, one should observe that the 
appropriate transition may be indicated symbolically as follows: 

r sin (^ -<#>)-*■ (y - v) [334] 

r 2 _ (2? _ xy 2Rx [335] 

and 

If - 2p -»• + (y - ,,)2 [336] 

whereas 

Rd\l/ —dri [337] 

in which the minus sign appears because the positive direction of traversal 
of the circular boundary in Fig. 21 is counterclockwise and in Fig. 22 
this corresponds to the negative direction for the y-axis. Finally it should 
be observed that the limits of integration corresponding to a counter¬ 
clockwise traversal of the circle are from + oo to — , or from — oo to 

+ 00 if the algebraic sign of the integral is reversed. 

When these substitutions are made and f(z) is assumed to vanish at 
infinity,* the integrals 317 and 318 become in the limit 

/(z) = uix,y} +jvix,y) = j J ^338] 

and 

/(z) = u{x,y) +jv{x,y) = - /* [339] 

x./-» + (y — v) 


The transformation of the Poisson integrals, which in their usual form 
apply to a circularly bounded region, to the forms given by Eqs. 338 and 
339, which apply to the right half plane, may be carried out in a some¬ 
what more satisfactory manner (than the heuristic one just given) by 
use of a linear fractional transformation (discussed in Art. 24) which 
effects the mapping of the interior of a circle about the origin upon the 
right half plane. 

From Art. 24, one finds that the transformation which reads 


f 

z — a 
z' a 


[340] 


transforms the interior of the unit circle in the z-plane int(» the right half 

♦The validity of the intefiral in Kq. .138 is restricted to this condition. The term /(O) in 
Eq. 317 becomes /(oo ) and drops out. 
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of the 2 ^-pIane, with the origin of the 2 -plane corresponding to the point 
s' = a on the real axis of the a'-plane. As the unit circle in the 2 -plane is 
traversed in the counterclockwise direction, the imaginary axis in the 
a'-plane is traversed throughout its entire extent from -|-y<» to —jaa 
(that is, in the negative direction). 

If 2 is some point within the unit circle, s' is a point within the right 
half plane. To a point f on the unit circle in the 2 -plane there corresponds 
a point {■' on the imaginary axis of the z'-plane which likewise is deter¬ 
mined from the transformation 340, that is. 


f = 


f' - g 

r' + g 


[341] 


The desired transformation of the Poisson integrals is carried out 
through returning to Eq. 309 and introducing there the change of variable 
expressed by Eqs. 340 and 341. One finds from a simple calculation that 


f - 2 


2u(f' - s') 


and 

df _ 2(1 </f' 

T ' (f' - g)(f' + g) 


[343] 


The integrand appearing in the integral of Eq. 309, therefore, becomes 


(f' - a){z + a) _ {T - a){z' + tf)| /(f') 


y' — 


r- 


(f' - a)(f' + a) 


[344] 


It should now be observ^ed that one wishes to have the origin of the 
2 -plane correspond to a point in the 2 '-plane which is infinitely remote 
from the origin, because the value of the function at the origin in the 
2 -plane (the quantity /(O) in Eq. 309) is then carried over into the value 
of the function at infinity in the ^'-plane. Under the assumption that the 
function vanishes at infinity (which must, of course, be met by any 
physical problem to which the resulting formulas are applied), the term 
involving/(O) in Eq. 309 then drops out. 

Although it is not possible to determine a linear fractional transforma¬ 
tion which maps the interior of a circle about the origin upon the right 
half plane in such a way as to make the origin or the center of the circle 
correstx)nd to the point at infinity (this would require an infinitely large 
value for the quantity a in Eq. 340), the desired end may be achieved in 
the present problem by considering the limiting process indicated by 
a —► C30 to be applied to the expression 344. The result reads 


f' 


1 





nn d^' 


[345] 
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Substituting this result for the integrand appearing in Eq. 309, dis¬ 
carding the term /(O) for reasons already stated, and noting that the 
algebraic sign of the integral is reversed if the integration is extended over 
the imaginary axis of the a'-plane in the positive direction, one has after 
dropping the primes on the quantities z and f 

which is the desired result. It is readily brought into the more explicit 
form given by Eqs. 338 and 339 through writing z = x +jy for any fixed 
point in the right half plane and t jn for the variable point of integra¬ 
tion along the boundary or imaginary axis. The two algebraic signs 
appearing in the integrand then yield respectively the results 


-r- {y — fij 

[347] 

and 


+ly - 

[348] 

which agree with Eqs. 338 and 339. 

Separating real and imaginary parts yields the pairs 


/ X 1 r* (y - v)v{0,v) j 
«(x,y) - 1 o , x 2 

X + {y — riy 

[349] 

/X 1 r“ (y ~ v)u{o,v) j 

[350] 

and 


, 1 XU{0,rt) j 

«(*>y) = / 2 . / X 2 

[351] 

, ^ if xv(0,v) J 

v(x,y) = / dv 

T*/—« x^ -i- (y — vY 

[352] 


The last two integrals determine the potential functions in the right 
half plane in terms of their respective values on the imaginary axis, which 
is regarded as the boundary of the right half plane. The individual rela¬ 
tions in the pair 349 and 350, on the other hand, may be used to determine 
either of the potential functions in the right half plane in terms of the 
boundary values of the conjugate function. A potential function along 
the boundary is given in terms of the conjugate function by either of the 



AH. 22] 


POISSON’S INTEGRALS AND HILBERT TRANSFORMS 339 


integrals 349 or 350 for x = 0. One thus obtains the pair of relations 



[353] 

c 

1 

8 

1 

.0,) = - 1 r 

IT*/— • y — 7j 

[354] 


which are known as Hilbert transforms. 

Because of the singularity of the integrand at the point i; = y, the 
value of either of these integrals, in the ordinary sense, does not exist. 
It is, however, possible to overcome this difficulty* by the definition of a 
particular process of evaluation yielding the so-called Cauchy principal 
value. This value is obtained through approaching the point rj = y 
symmetrically from both sides, as indicated for the integral 353 in the 
following expression: 



df) 

y - n 



vjv) 
y - V 



y - vJ 


[355] 


In order to see that this limit has a definite value, one may represent 
the function v{ri) as 

v(v) = v(y) + (v - y) ■ p{y,v) [356] 


in which p{y,v) is regular in the vicinity of the point rj = y. Then 


%/—flo y — O — flo y — %J —• 




[357] 


The principal value of the first of the two integrals on the right-hand side 
is obtained through the following steps: 


r + J = - In (y - Ij) - In (y - ij)! 

y — n Ji/+t y — V L J-« L X+* 


When this is written in the form 


[^In (y - - j^ln (y - 

the limiting process is found to yield 

[to . 0 


[358] 

[359] 

[360] 


*See E. C. Titchmarsh, “ Conjugate Trigonometric Integral?,” Proceedings of the London 
Mathematical Society, 2nd series, 24 (1926) 109-130; “ On Conjugate Functions,” ibidem, 
29 (1929) 49-81. 
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Hence only the second integral on the right-hand side of Eq. 357 remains. 

According to Eq. 356, the integrand piy^v) of this second integral is 
obsei'ved to decrease no faster than 1/tj for large values of r) regardless of 
whether v{rj) vanishes or remains finite for ?; —> oo. Although it is true 
that the integral from zero to infinity of a function which decreases no 
faster than I/t) for large rj does not remain finite, it is essential in the 
present instance to observe that if the limits of the integral are from — oo 
to 00 , and the integrand is an odd function about the point ?; = oo, one 
can appreciate in a general way how a finite value can result by noting 
that the contributions to the integral on the {xisitive and negative sides 
of the point oo have opposite algebraic signs. This is the same sort of 
reasoning as that involved in deriving the finite principal value 355. 

By reference to Eq. 356 it is seen that if v(rj) vanishes for ?/ —> oo, then 
p{y,v) is an odd function about the point = «>; but if v{7j) remains 
finite in this vicinity, piy^v) is odd about 77 = oo only if v(7)) is an even 
function; that is, Uvi — rj) = v{r}). Hence one is led to the conclusion that 
the given potential function v{rf) either must vanish for 77 oc or must 
be an even function of 77. Inasmuch as an odd function about oc must 
necessarily be either zero or infinite at infinity, it is sufficient to state 
merely that the potential function ^'( 77 ) shall remain regular in the 
vicinity of 77 = 00 Since all the above discussion applies equally to the 
evaluation of the integral 354, the same final comment applies also to 
the conjugate function u{r}). 

It is thus seen that the transforms 353 and 354 may be written in the 
alternative form 


U(y) = J 

71 - - 00 

»Cy) = - “ / 

TT */- 


^(^). - ^(y ) 

y - 'n 


dri 


” - ^(y) 

y - 77 


drj 


[361] 

[362] 


Here the functions v(rj) — v{y) and ^^(v) — w(y) vanish in the vicinity 
of the point 77 = y at least as strongly as the factor (y — 77), so tliat there 
can be no question as to the finiteness of the integrals so far as the 
presence of the factor (y — 77) in the denominator of the integrand is 
concerned. 

In the evaluation of the integrals 351 and 352 for the boundary x = 0, 
a difficulty arises due to the fact that the integrand vanishes everywhere 
with the possible exception of the point 77 = y. Yet it must be true that, 
in the limit x 0 , the integrals yield the values «(0,y) and v(0,y). That 
they do so, may be shown in the following way. 

*For a more thorough discussion of the question of convergence of the Hilbert transforms 
the reader is referred to the article by E. C. Titchmarsh already cited. 
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Since the only possible contribution to the value of the integral in the 
limit X —*0 must come from the immediate vicinity of the point v = y, 
it is clear that for example, the function u{0,r)), in Eq. 351, may be re¬ 
placed by its value M(0,y) at the point v = y, and since it then has 
nothing to do with the process of integration it may be placed in front of 
the integral sign. It then remains to show that 


«(0,y) = “—[limit r - T - — 

TT [ x-"*0 X 'T~ ( 


drj 


[363] 


or that 


+ (y — vY^ 


which is evidently true. 

To return to the integrals 353 and 354 (or the equivalent ones given by 
Eqs. 361 and 362), it is useful to observe that if v(ri) is an odd function 
of 7?, then w(r|) is an even function, and vice versa. To see this, one may 
write the integral 353, for example, as 


w(y) =- r 

TTt/—» y — 77 tJo y — rj 

[365] 

or 


TT «/) — 77 TT » A) V — n 

[366] 

If v(r]) is assmned to be odd, replacing the variable of integration tj in the 
first of the above two integrals by — shows that 

1 /•-“« virf) drj 1 di'n 

TTt/o y y -f- V 

[367] 

Hence Eq. 366 becomes 


«(y) = /* (' ,■ ')v{v)dv 

vJii \y — i; y d- 1 ]/ 

[368] 

or 


«w - - - r - 

ttJo ?7^ — y^ 

[369] 

From this form it is immediately evident that u{y) is an even function 
of y. 

By means of an entirely parallel process, one may transform the 
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integral 354 with u(ri) assumed to be even and obtain 



from which it is apparent that v(y) is an odd function of y. 

It is to be obser\Td that the transforms 369 and 370 are no longer 
general but apply only to cases in which u is even and v odd, as is assumed 
in their derivation. This restricted character of the forms 369 and 370 is 
recognized at once from the fact that these integrals no longer become 
interchanged when u is replaced by —v and z; by —w. 

One might just as well have derived special forms for the opposite 
assumptions, namely that u be odd and v even. However, for the rational 
functions and many others met in practical problems, the real part is 
even and the imaginary part is odd when regarded as a function of y for 
X = Oy that is, for pK)ints on the imaginary axis. The following more 
detailed discussion pertains to this important special case. 

If the same method of transformation is applied to the equivalent 
forms 361 and 362, the results obtained are 


TTt/O 7)^ — y- 


[371] 


and 



«(??) - u(y) j 

- '2 - 2 - 

- r 


[372] 


The last of these is the same as 370 except that u(ri) — u{y) replaces 
u{rj)* 

It should be mentioned that the even function u{y) is determined by 
the integrals 369 or 371 except for an arbitrary additive constant. How¬ 
ever, the difference between any two values of u{y) for specified y-values 
must be uniquely determined. For example, using the integral 369, one 
finds 

m(oo) - m(0) = - f [373] 

TtJo 7) 


which is a simple expression for the difference between the values of u 
at the two extremes in the range of y-values. 

This last expression may be put into a practically more useful form 
through introducing the change of variable indicated by 

0 = ln(-') de=^— [374] 

\yo/ v 

*If a given potential function Is constant, the conjugate function is zero. Therefore, the 
conjugate of u{r\) -f constant is the same as the conjugate of 



Art. ^^] 


POISSON^S INTEGRALS AND HILBERT TRANSFORMS 343 


which amounts to introducing a logarithmic scale in place of the linear 
17 - or y-scale and choosing the arbitrary point ri = yQ sls the new origin. 
If v(6) represents the function v{ti) with respect to the logarithmic 
0 -scale (that is, v{d) is v{rf) plotted on a logarithmic scale), the relation 
373 takes the form 

«(cc) - u(0) = ? r* v{e)de [ 375 ] 

TT t/— 00 

or 

* 

1^(0) = 2 “ "(0)] [376] 

in which w( <» ) and w( 0 ) still denote the values of u for y = 00 and y = 0 
respectively.* 

This result states that the net area under the curve for the function Vy 
plotted on a logarithmic scale, depends only upon the difference between 
the values of the corresponding w-function at the extremes of the y-scale. 
Although this result is only a partial statement of the implicit relation 
between the conjugate potential functions u and i', its simplicity makes it 
particularly useful in connection with the practical problem discussed in 
the references just cited. 

A comparable result obtainable from the integral 370 reads 

limit lyt'(y)] = - r u{ri) drj [377] 

y —» «Q TT v 0 


Another useful particular relation between u and v for points on the 
imaginary axis (f = jrjy z = jy) may be obtained from the integral 372. 
The latter may be rewritten in the form 



drj 

V 


[378] 


Introducing the change of variable 



[379] 


and writing u{e) for the function «(i?) in terms of the new logarithmic 
variable 6 give 


V{y) = - f 
TT ' 


u(6) — m( 0) 
' sinh 0 


do 


[380] 


•This particular form as well as the ones given by Eqs. 377, 380 and 393, were obtained by 
H. W. Bode. See his U.S. Patent 2,123,178; also “ Feedback Amplifier Design,” Bell System 
Technical Journal, 19 Uuly 1940), 421-454. 
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The integrand in this integral remains regular throughout the entire 
range — «> <6 < «. At the limits B — u{B) has the finite values 
of u{ri) for »7 = 00 and = 0 respectively, whereas 2 sinhfl—» 
so that the integrand is seen to behave like for large positive or 
negative values of 6. For the vicinity of the fx)int 6 = 0, 

[381] 

and 

sinh 6^6 [382] 


so that the integrand there maintains a finite value. 

The integral 380 may be transformed into a more useful form through 
the method of integration by parts, which reads 



11 

1 

[383] 

Letting 

II 

1 

O 

[384] 

and 

, dB 

^ ~ sinh B 

[385] 

one has 

Us 

II 

[386] 

and 

e 0 

[387] 


5 = In tanh - = — In coth - 


Thus Eq. 380 becomes 
v{y) = "[{“W ~ “(0)1 IntanhyJ + 

[388] 

in which the absolute value of the variable fl must be used because the 
integral 380 has a real value and hence the argument of the logarithm 
must remain positive. Since the quantity u{6) — u(0) appearing in the 
first term of Eq. 388 remains finite at the limits B = db<x>, the value 
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of this term is zero at both limits. Its values throughout the range 
— 00 <e < 00 , moreover, are finite, since at the critical point 5 = 0 it 
has the value 



This term, therefore, vanishes and there remains 

"W = if-'. (^)^ P90] 

The factor In coth ^ appearing in the integrand has a logarithmic 

infinity at the point ^ = 0 and is a symmetrical function about this jx)int, 
dropping off rather rapidly on both sides. Since S = 0 corresponds to 
7} = y, it is seen that the value of the function z‘(y) at any point is largely 
determined by the slope of the conjugate function tiirj) at that point 
when plotted on a logarithmic scale. 

This inter{:)retation of the result expressed by Eq. 390 may be clarified 
through writing 

dS/Q^Q \d7} dB/i^^y \d'r))xdB/Q 
and noting that* 

/*“ In coth dd^2 f" In coth ^ ^ 

«/— OP 2 2 2 

Then, by adding and subtracting {du/dd)i) to {du/dd) in the integrand of 
Eq. 390, one obtains the form 

" 2 (‘^).+ ir. i(fo - 0,1 ^ 


[391] 

[392] 


Here the first tenn represents the major contribution to the function 
v(y). If u{B) is a symmetrical function about a given point i? = y (that is, 
^ = 0), then {du/dB) — (du/dB)^ is an odd function about this point and 
(because In coth [;^|/2] is even about 0 = 0) the contribution of the 
integral in Eq. 393 becomes zero. Its value in any case is seen to depend 


^Making the chiinge of variable a* = coth 0-2, one finds 


2 


i 


In coth " do 
2 



In xdx 
1 


2 


which is No. 3 of Table 187 in Bicrens de Ilaan, Nouvdles tables d'inlegrahs definks (Engels, 
Leiden), 1867. 
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only upon the asymmetry of the function u(d) about the point = 0, and 
because of the critical character of the factor In coth (|ff|/2), only the 
asymmetry in the more immediate vicinity of this point can have an 
appreciable effect. 

Although the computational labor involved in the solution of many 
problems of this sort may be quite heavy, the necessary theoretical basis 
for such a solution is evidently afforded by the Hilbert transforms or by 
modifications of these. However, when certain aspects of electric circuit 
theory are dealt with, a somewhat more complicated version of the 
problem presents itself. Instead of either «(y) or v{y) being specified over 
the entire range 0 < y < «, «(y) is specified only over portions of this 
range and viy) is specified over the remainder. For example, «(y) may be 
specified for 0 < y < yo and v{y) for yo < y < The problem is to 
determine u(y) and i’(y) for the ranges in w'hich they are not specified,* 
that is, the object again is to determine the whole complex function over 
the entire range 0 < y < <». 

The clue to the method of solution lies in dividing the complex function 
u(y) +jv(y) by the irrational factor v 1 — yVyo^, which is real over the 
range 0 < y < yo and imaginary over the complementary range yo < 
y < 00 . Hence the resulting function reads 


u(y) v(y) 

- hj - 




for 0 < y < yo 


[394] 




and 


v(y) 


u(y) 




for yo < y < » 


[395] 


The significant part about this re.sult is that the real and imaginary 
parts of the resulting function alternately involve u and v in the two 
ranges. The same effect may, of course, be obtained if the complex func¬ 
tion u -hjv is multiplied instead of divided by the irrational factor, but 
the resulting real and imaginary parts might then no longer remain finite 
in the vicinity of the point y = «. Also, one could presumably find other 
irrational functions which are alternately real and imaginary in the 
ranges 0 < y < yo and yo < y < “, but the one used above is perhaps 
the simplest. 

Substituting the real and imaginary parts of the functions 394 and 
♦The solution to this variation of the problem was obtained by H, W. Bode, loc, cil. 
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395 for M(y) and v(y) in the transforms 369 and 370, one finds respectively 
2 


W(v) dy 




for 0 < y < yo 


[396] 

for yo < y < » 


for 0 < y < yo 


[397] 


for yo < y < «• 


Equation 397 is used when u(y) is specified over the range 0 < y < yo 
and ti(y) over the range yo < y < «»; Eq. 396 applies when the reverse 
is true. As an illustrative example, one may suppose that u(y) is specified 
to be constant throughout the range 0 < y < yo and that ii(y) is constant 
over the complementary range. Inasmuch as u(y) is, by the present 
methods, determined within an arbitrary constant, one may simplify 
these given data somewhat by assuming u(y} to be zero over the range 
0 < y < yo and adding the desired constant value to the whole solution 
afterward. Thus one has for the given data 

u(y) = 0 for 0 < y < yo ^ , 

[398] 

v(y) = t'o for yo < y < <» 


When Eq. 397 is applied, the first integral drops out because « = 0. 
The remaining expressions are somewhat simplified by the substitutions 


r 


V 
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One then has 


2v(jXo r “__ 

«■ *^1 - Xo^Wx^ - 1 


V{Xo) 

Vl - Xo^ 

- u{Xq) 

, Vxo- - 1 


for 0 < aco < 1 
for 1 < *0 < 00 


[400] 


The integration may be accomplished through noting first that 


*0 



dx, 

(x^ - Xo^)V^^ 


I P“‘ dx 

2 J 1 (x — Xo)'^— I 

1 r* dx 

(x + Xo)^X^ — 1 


Using the substitution 

XXo — 1 

z =- 

X - Xo 


one finds 

dz _ — xo^ dx 

vT^ ~ (a: - Xo)\/'x'^ - 1 

whereas with 

XXo + I 

Z = -;- 

X + ,ro 


there results 

dz _ — •\/l — xo^ dx 

Vl — {x + Xo)V x^ — 1 


[401] 

[402] 

[403] 

[404] 

[405] 


The changes in the limits of integration which accompany the substitu¬ 
tions 402 and 404 being noted, the integral on the left-hand side of Eq. 
401 is found to be given by 


1 

2 V 1 - V 



+ 


r 

J\ ^ 


dz 


\ vT 



[406] 


The integrands in these integrals are even functions. Hence the integral 
from 1 to Xo may be replaced by one from —Xq to —1. The two integrals 
in the expression 406 may then be combined, giving 


2voXo r- 


dx 


(x^ — Xo^)V x^ — I irVT 


_ 

1 ~ 


dz 


V1 — 


[ 407 ] 
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The integration is now no longer difficult. Equation 400 is thus observed 
to yield for 0 < *0 < 1 

I’C^o) = — sin“^ % = — In (VI — + jxo) [408] 

IT W 

whereas for 1 < *0 < », in which range it is appropriate to consider the 
right-hand side of Eq. 407 in the form 

— r*o dz 
vVxo^ — 1 Vz^ — 1 
the integration jdelds the real part 

u(xq) = — In (V xo^ — 1 + * 0 ) 

One readily recognizes from these results that the complete complex 
fifftction is given over the entire range 0 < y < oo by the expression 

u(y) + jviy) = — In (Jl - ^ [411] 

IT \\ yo yo/ 

The procedure may readily be extended to problems in which the range 
0 < y < 00 is divided into more than two subranges. For example, if u 
and V are alternately specified in the ranges 0 < y < yi, yi < y < y 2 , 
y-> < y < , the Hilbert transforms are applied to the real and imagi¬ 

nary parts of the function (m +jv) divided by V(1 — yVyi^)(l ~ yVy 2 ^)» 
The determination of the appropriate detailed relationships foUows the 
same pattern as given above for the simpler problem involving two sub¬ 
ranges. 

23 . More about potential theory and conjugate functions 

Additional useful physical interpretations relevant to properties of 
functions of a complex variable may be had from pursuing further the 
intimate relationships between certain of these properties and potential 
theory. The starting point for the present discussion is the simple physical 
situation shown in Fig. 23. The plane of the papier, which is also regarded 
as the complex z-plane, represents a plane perpendicular to an infinitely 
long straight conductor. The origin of co-ordinates for this plane is chosen 
coincident with the conductor, which is assumed to carry a uniform linear 
distribution of charge of q coulombs per unit length and also a uniform 
current of i amperes whose reference direction peints upward. 

According to elementary theory, the electric field intensity S and the 
magnetic flux density S at the pwint zo are given by the negative gradient 


[409] 

[410] 
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of corresponding potential functions 13 and CF, that is, 

g = — grad T? = 

with 

1? = ^ In - 


^-plane 

/zo 


'’A 
/ <6 


/ \ 

0 

conductor 


and 


grad y [412] 

[413] 

[414] 


Fig. 23. The plane perpen- ^ 

dicular to an infinitely long 

straight charged conductor which £ and fi are the dielectric permittivity 
carrying current. and magnetic permeability respectively of the 

homogeneous isotropic surrounding medium.* 
The field components in polar co-ordinates are 

, d’G 

= — 


_ dT> 


% = - 


dJ 


= — 


f d<ft 

dJ 


dr ’ ^ rd<t> 

By substitution from Eqs. 413 and 414 these become 

6^ = 0 

2/xi 


P _2?. 


% = 0 ; = 


[415] 

[416] 

[417] 

[418] 


It is now useful to observe that if one defines a single complex potential 


function 

, , <* , 1 

w = — +j—.= —In = In — 

2q £iit Zo 

[419] 

in which 

II 

[420] 

the field components are determined from 



dW SSr . ffir 
dr 2q ^ 2id 

[421] 

and 

dw 

r d(t> 2q ^ 2jLii 

[422] 


*Unrationalized MKS units are used m these discussions. 
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or the resultant fields from the relation 


— grad w — 


— 4 . ■ — 
2ni 


[423] 


The real and imaginary parts of the gradient of the complex potential 
function w yield the electric and magnetic fields respectively (except for 
constant multipliers). 

It is thus seen that the real and imaginary parts u and v of the simple 
function 

w In — — u +jv [424] 

^0 


when multiplied respectively by the constant factors 2q/e and 2fxi are 
the scalar electric and magnetic potential func¬ 
tions for the single charge and current-carrying 
conductor of Fig. 23. This example, incidentally, 
affords an interesting physical interpretation of the 
multivalued character of the logarithm function. 

Since, for the scalar magnetic potential 7, the 
radial lines are equipotential loci, this function 
changes continuously in the same direction as 
one proceeds along a path encircling the con¬ 
ductor, each complete revolution yielding an 
increment prop)ortional to 27r. If 7 is likened to Fig. 24. The plane 
an altitude function in a physical terrain, the perpendicular to a pair 
similarity of the Riemann surface to a winding identical infinitely 

ramp is realized. The branch f>oint about which uctors carry- 

. ^ . . , , . r 1 • current in opposite 

the surface winds becomes, in terms of this mag- directions and carrying 

netic field interpretation, a vortex thread which is opposite charges, 
physically realized by the current-carrying con¬ 
ductor. This singularity for the field and the function representing it is 
indeed the seat of its excitation. 

A pair of identical conductors are now considered. They are spaced 
symmetrically with respect to the origin as shown in Fig. 24 and are 
assumed to carry charges and currents of equal magnitude but opposite 
sign. The complex potential function in this case is, with reference to 
the notation indicated in the figure, 

1 1 I 1 r . 

w = In-In-;— [425] 

Zo — a Zo + a 



or 


» - In 

\ao - a/ 


[426] 
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It is now assumed that the spacing la between the conductors is very 
small compared with the distance to any point Zo at which the field (or 
the resulting function) is to be studied. For the moment this spacing 
may be regarded as being finite, although for some of the subsequent 
discussions it is more appropriate to allow the limiting process a —> 0 to 
be completed. At all events the condition 




< 1 


is assumed to be fulfilled, so that Eq. 426 is replaceable by 


w 


( Id 
^ In ( 1 + — 


la 

2o 


[427] 


[428] 


with any accuracy that may become necessary. This form for w may be 
obtained through expanding the logarithm in a Maclaurin series in terms 
of the variable 2a/So and retaining only the first term, or it may be derived 
in a somewhat more lucid fashion through first writing the right-hand 
side of Eq. 425 in terms of the defining integral for the logarithm, thus 


w = In (zo -h a) — In (zq ~ ®) = J 

(•*0+0 ^*0““ df 

1 T~ 7 

[429] 

which is equivalent to 

/**o+o 

w= j — 


[430] 


If the condition 427 is fulfilled, then the points zo -f a and Zq — a eire so 
close together that this integral is very nearly given by 


1 , 2a 

vj — — f = — 

So •'*0—® So 


[431] 


which agrees with Eq. 428. 

As stated above, the conductors in Fig. 24 also carry currents i having 
equal magnitudes and opposite directions (upward from the plane of the 
paper for the conductor carrying +q) so that the real and imaginary 
parts of iv again represent scalar electric and magnetic potential functions 
when multiphed by their appropriate factors. These, incidentally, may 
just as well be assumed to be numerically equal, as expressed by 



(numerically) 


[432] 


Then the common factor may be included in the expression for w. Since 
this procedure facilitates matteis somewhat, it is assumed for the follow- 
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ing discussion that 


4oa 

w = 

ezo 


[433] 


It is now possible to let the spacing 2a become as small as desired 
without having the magnitude of w become small at the same time, since 
one can demand that as 2a is made smaller and smaller, the charge q 
be made correspondingly larger so that the product 


2aq = m [ 434 ] 

remains constant. In the limit a—> 0 ,9 approaches infinity. This limiting 
configuration of oppositely charged conductors is a useful concept eind 
is referred to as a dipole or doublet. The quantity m, called the moment of 
the dipole, is considered to be a vector coincident with the line joining 
the two charges (the axis of the dipole) and directed from the negative to 
the jwsitive charge. The vector character of this dipole moment is taken 
into account through its being considered a complex number although 
in the present example it is real, as is evident from inspection of Fig. 24. 

The complex potential function for the dipole is 



2m 

er 


[435] 


and the scalar electric and magnetic po¬ 
tential functions are the real and imagi¬ 
nary parts 


2m 

« = — cos <t> 

er 


[436] 


and 


2 m . 

V ^ -sin <t> 

er 


[437] 


Although in this derivation the dipole 
is assumed to have a very particular lo¬ 
cation and orientation in the z-plane. 



Fig. 25. A dipole of moment m 
with arbitrary position and 
orientation. 


namely, that shown in Fig. 24, one may readily generalize the expression 
435 so that it becomes appropriate to a dipole in an arbitrary position 
and orientation as is shown in Fig. 25, where the dipole moment makes 
an angle \p with the reference axis. The dipole is located at an arbitrary 
j)oint z, so that one now has 


(20 — z) = re’* 


[438] 


With m denoting the magnitude of the dipole moment, it is readily seen 
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that the appropriate modification of Eq. 435 reads 


2me’* 

6(20 — z) er 

[439] 

which has the real and imaginary parts 


2m ,, . 

u = — cos (^ — 0 ) 

6 r 

[440] 

and 


= — sin (^ — 4>) 
er 

[441] 


It is significant that if the dipole is rotated through 90 degrees in the 
clockwise direction — that is, if ^ is replaced by ^ — (ir/ 2 ) — then u 
becomes replaced by Vy and by —u. In other words, rotation of the dipole 
through 90 degrees in the clockwise direction has the effect of replacing 
each potential function by its conjugate. Further discussion of this useful 
observation is given presently. 

The preceding derivations also show that the dipole may be regarded 
as the result of merging two logarithmic singularities of opposite polarity 
and infinite magnitude. As Eq. 439 shows, the end result is a simple pole, 

and the complex residue of the function w in 
this pole, except for the factor 2 /e is numer¬ 
ically equal to the vector moment of 
the dipole. One thus obtains an interesting 
physical interpretation for the kind of sin¬ 
gularity designated as a simple pole, 
namely, that it may be visualized as the 
seat of an electric or magnetic dipole with 
its moment proportional to the residue of 
the function in this pole. 

It is logical to continue with a similar 
study of poles of a higher order of multi¬ 
plicity. As the following discussion shows, 
these are represented by the merging of 
symmetrical configurations of larger num¬ 
bers of charges having equal (infinite) magnitudes but signs which are al¬ 
ternately positive and negative, there being an equal number of each. For 
example, the configuration following the dipole in its order of complexity 
is the so-called quadripole, consisting of two positive and two negative 
charges arranged alternately and spaced symmetrically on the circum¬ 
ference of a (vanishingly) small circle of radius a. Next in the order 
of complexity is the configuration involving six charges of which three are 



Fig. 26. A 2»-pole centered at 
the origin. The position of -f 
and — charges is correlated to 
the form of the resultant com¬ 
plex potential function. 
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positive and three negative, and so on. In general such a configuration is 
referred to as a 2 w-pole, n being the number of positive or negative 
charges. The dipole is a 2«-pole for « = 1; the quadripole is a 2w-pole for 
« = 2 , and so forth. 

Figure 26 shows a 2n-pole for « = 6 with its center at the origin of the 
z-plane. The points 22 , • • * 22 n are uniformly spaced on the circum¬ 
ference of the small circle, the even-numbered ones corresponding to 
positive charges and the odd-numbered ones to negative charges. The 
resultant complex potential function is given by 

w — —\\n — ^ -f- In — -h * * • + In- - - 

S L ^0 Z 2 Zq 24 Zq 22n 

— In —^-In —-- • • — In-^- 1 [442] 

Zo - Zi 2 o - 23 So - Z2n-iJ 


or 


h In (20 - 2 l)(Zo - Z3) • • • (20 - Z 2 n-l) 
e (Zo - 22X20 - 24) • • ■ (20 - 22„) 


[443] 


Now it is recognized that the values of Zi, 23 , • • • Z 2 n-i are the roots of 
the equation 

z" + c" = 0 [444] 

which are 

2 = a \/ — 1 = (v = 1, 3, 5, • • • 2« — 1 ) [445] 


and the values of 22 , 24 , • • • Z 2 n are the roots of the equation 

2 " - a" = 0 [446] 

which are 


z = a v^l = (»» = 2, 4, 6, • • • 2 n) [447] 

Consequently, 

(zo - Zi)(2o - 23 ) • ’ • (2o - Z 2 n-i) = Zo" + a” [448] 


and 

(20 - Z2) (20 - 24) • • • (Zo - Z 2 n) = Zo" - a" 
so that Eq. 443 becomes 



[449] 

[450] 



Again if 


[451] 
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the logarithm in this expression is very nearly given by 




2 a"\ ^.4ya" 
zo”/ "" £2o" 


[452] 


If the moment of the 2M-pole is defined as 

m = 2qa” [453] 


its complex potential function becomes 



w = 


2m 

ezo” 


2m 

er" 


g-in4, 


[454] 


which yields the result expressed by Eq. 
435 forn = 1. 

When the 2w-pole is located at an arbi¬ 
trary point z and has an arbitrary orienta¬ 
tion, as shown in Fig. 27, its complex 
potential at the point Zq is given by 


0 


2 wc^'"^ 
e(zo - z)" 


[455] 


Fig. 27. A 2n-pole centered at z. because Zq in Eq. 452 becomes replaced 

by (zo — z)e~’*. Here the angle yf/ is evi¬ 
dently determined only within an additive positive or negative integer 
multiple of the angle 2ir/«. 


If again one writes 
when 


so that 


and 


(zo — z) = re^* 

a, = 

er" 


2»t . 

u = - if,) 

CT 


® = eTi sm n{yf> - 4,) 


[456] 

[457] 


[458] 


[459] 


According to Eq. 455, the 2M-pole evidently represents a pole of 
multiplicity » for the function w. 
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It is now of interest to consider a configuration of charges resulting 
when many identical dipoles are placed side by side, with a uniform 
infinitesimal spacing, their centers lying on any curve and their moments 
all pointing toward the same side of this curve. Such an arrangement is 
shown in Fig. 28. If the dimension perpendicular to the plane of the paper, 
in which longitudinal uniformity obtains, is mentally supplied to this 
picture, it is readily recognized that this arrangement may be regarded as 



Fig. 28. The cross section of a sheet having a uniform surface distribution of dipoles. 

a uniform surface distribution of dipoles, and that the result is equivalent 
to having a surface or membrane uniformly covered with a charge of 
equal magnitude but opposite sign on its two sides, the thickness of the 
membrane corresponding to the spacing la between the charges in the 
dipioles. 

This configuration is called a uniform double stratum. If the magnitude 
of the surface density of charge is denoted by o*, and la is the thick¬ 
ness of the membrane, or the separation of the surface charges of 
opposite polarity, 

lac = T [460] 

is defined as the moment of the double stratum. In terms of the individual 
dipoles with their charges ig, one recognizes that if the uniform spacing 
between the dipoles is denoted by the differential ds^ 

q = ads 


[461] 
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and hence 


2aq = m = r ds 


[462] 


The problem is to determine the scalar electric potential u at the point 
2 o. This may be determined through integrating the expression 440 over 
the surface of the double stratum. Thus, the differential contribution to 
the net potential at Zq due to the single dipole at the point z is, with the 
help of Eq. 462, 


du == — cos — 0 ) = 
er 


2 t ds cos — 0 ) 


er 


[463] 


But from Fig. 28 it is recognized that 

—rd<l> = ds cos {ip — tf>) [464] 


so that Eq. 463 becomes 



[465] 


Hence one obtains for the net potential at the point Zq 

2t , 2r . 

u = I du — -I d<t> — — (01 — 

•Jzi e e 


[466] 


This remarkably simple result states that the px)tential is proportional 
only to the net angle subtended at the point r;o by the boundaries of the 
double stratum. The shape of the double stratum between these bounda¬ 
ries is immaterial. It is essential to the achievement of this simple result 
that the moment r of the double stratum be constant over its entire 
surface. The expression given by Eq. 466 applies only to the potential of a 
uniform double stratum. 

It is now a simple matter to find the potential function which is the 
conjugate of this potential u of the double stratum. It is pointed out 
above in connection with the single dipole that the conjugate to the 
electric potential function u results when that dipole is rotated through 90 
degrees in the clockwise direction. According to the principle of super¬ 
position, the conjugate to the double-stratum potential results when all 
the dip)oles constituting it are rotated through 90 degrees. This process 
converts the double stratum into a dipole chain. If one chooses to make 
the spacing ds between the dipoles in the double stratum equal to the 
spacing 2a between the charges in the individual dipoles, that is, if 

ds = 2a [467] 

the adjacent positive and negative charges in the dipole chain fall on 
top of one another and hence cancel, so that there is left only one nega¬ 
tive charge —9 at the point Z 2 and one positive charge q at the point Zi. 
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The choice indicated by Eq. 467 is, according to Eq. 462, equivalent to 
making 

9 = T [468] 

so that the potential function conjugate to « given by Eq. 466 becomes 


2t r-i 
V = — In — 
e fi 


[469] 


Since replacing u by v and » by —« again yields a pair of conjugate 
potential functions, one may also write 


and 


2 t fi 

u = —In — 

e r2 


2 t - 

® — (<^j — <^2) 


[470] 

[471] 


These are evidently the real and imaginary parts of the complex function 


2t 



In 



[472] 


in which zq of Fig. 28 is now considered to be any variable point 2 . 

The response functions of linear passive electrical networks (driving 
point and transfer impedances or admittances) are rational functions 
of the form 


/(z) = 


(2 - 2 i )(z - 23 ) • • • (2 - Z2m-i) 
(2 - 22 X 2 - 24 ) • • • (z - Z2m) 


[473] 


In problems of this sort it is expedient to write 

f{z) = ■= 

and have, for the so-called loss and angle functions A and B, 

, , , (Z - 20(2 - Z3) • • • (Z - Z2m_l) 

= = (2 - Z2)(2 - 24) . . • (z - Z2„) 


[474] 

[475] 


Thus the loss function A may be regarded as the electric potential result¬ 
ing when a system of identical charged conductors are placed at the 
points 22 , Z 4 , • • • 22 m and a set of conductors with charges of opposite 
sign are placed at the points Zi, 23 , • • • 22 m-i. The function A is usually 
studied for pure imaginary values of 2 , that is, for points on the imaginary 
axis in the z-plane (these correspond to real frequencies in steady state 
circuit analysis). B is then the conjugate potential function with respect 
to .4. A problem in network design is thus reduced to the determination 
of a distribution of the points Zi, 22 , Z 3 , • • • which yields suitable functions 
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A and B. The visualization of the problem lent by the analogy to po¬ 
tential theory can in many cases be helpful. 

If the rational function, Eq. 473, is expanded in partial fractions (as 
shown in Art. 16), each term is recognized as having the form of Eq. 439. 
The real and imaginary parts of this fvmction may, therefore, be in¬ 
terpreted as the potentials due to dipoles at the points 22 , Z 4 , • • • 22 m- 
More specifically, the real part (which may be a resistance or con¬ 
ductance) is the potential of the dipole distribution represented by the 
partial fraction expansion olf(z), whereas the imaginary part (a corre¬ 
sponding reactance or susceptance) is the conjugate potential resulting 
after all the dipoles are rotated through 90 degrees in the clockwise 
direction. 

24. Some useful functions in conformal mapping; the linear 

FRACTIONAL FUNCTION 

The artifice of introducing a change of independent variable by 
substituting for the given one some function of a new variable usually 
implies the transformation of one region of the complex plane into 
another. A contour in the one region is thereby mapped upon the other. 
The two regions may be mutually exclusive, or partly or wholly over¬ 
lapping, depending upon the nature of the transforming function. A very 
common substitution is 



which is more explicitly written 


f f+yn 


1 

* +jy 


X -jy 

x^ + y^ 


whence 


I = 




In polar co-ordinates 


z = re’* 

r = pc'® 


so that the transformation 476 yields 


P = 


1 

f 


[476] 

[477] 

[478] 

[479] 

[480] 


[481] 
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and 

^ = -0 [482] 

Because of the relation 481, this substitution is spoken of as a transforma¬ 
tion in terms of reciprocal radii. Since p is larger than, equal to, or smaller 
tlian unity as r is respectively smaller than, equal to, or larger than unity, 
it is seen that the region of the s-plane within the unit circle is trans¬ 
formed into the region outside this circle, and vice versa, whereas the unit 
circle itself remains intact except for a shifting of specific points according 
to the relation 482. In particular, the points dbl on the real axis remain 
fixed by the transformation, and these are consequently spoken of as the 
fixed points. 

A significant property of the transformation 476 is that the origin 
and the point at infinity become interchanged, that is, s = 0 corresponds 
to f = 00 , and s = oo corresponds to f = 0. Thus a given function J(z) 
may be studied in the vicinity of 2 = oo through introducing the change 
of variable 476 and then studying the resulting function F(f) = fiX/z) in 
the vicinity of f = 0. 

A variation of this transformation reads 



[483] 

in which the bar indicates the conjugate value. With 


f* = p*e’^' 

[484] 

this yields 


* 1 

[485] 


and 


[486] 


All the points on the unit circle are now fixed points. Corresponding points 
s and may be found by means of the geometrical construction indicated 
in Fig. 29, as may be seen from the fact that the similar right-angle 
triangles yield the relation 


\z\ _ Oji 

^ ~ rn 


[487] 


in which OA is the radius of the unit circle and hence equal to unity. The 
point f* is said to be the image of the point s with respect to the unit circle. 
The transformation indicated by Eq. 483 is, therefore, also spoken of as a 
reflection or inversion w'ith respect to the unit circle. As the point z traces 
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some figure inside the unit circle, the corresponding point maps the 
image of this figure outside the unit circle. 

If the unit circle is replaced by a circle of radius R, the transformation 
reads f* = R^/z. The geometrical construction shown in Fig. 29 applies 
to any value of i?. If i? — | 2 | is held constant as R is allowed to become 

larger and larger, and attention is focused 
upon that part of Fig. 29 in the vicinity of 
the points z and f* alone, the circle will 
appear to degenerate into a straight line 
and the two points in question will ulti¬ 
mately be symmetrically located with re¬ 
spect to this line in the sense of an object 
and its mirror image. 

Other variations of this transformation 
which are sometimes used are f 

and f*' = — f* All these substitutions 
have the property of transforming circles 
into circles, as is shown from a more general 
px)int of view in the subsequent discussion. 

The transformations f = ± 1/2 are, of course, conformal, and hence, 
as shown in Art. 2, angular relationship')s are preserved in sense as well as 
in magnitude. The transformations = ± 1/2 are isogonal but not 
conformal. They preserve angular relationships except for a reversal of 
the px)sitive sense of angular measurement, as in the right- and left-hand 
relationship between an object and its mirror image. For any closed con¬ 
tour not encircling the origin,* the direction of traversal is preserved by 
the transformations f = ± 1 / 2 , whereas it is reversed in the transforma¬ 
tions = ± 1 / 2 . These relationships arc indicated for a set of circles in 
Fig. 30, in which a typical p)oint P on the given locus 2 is also indicated in 
each of the transformed loci. 

It is collaterally useful to observe that, for the transformations = 
— 1/2 and f* = 1 / 2 , a given locus lying wholly in the upper (respectively 
lower) half plane, remains wholly within that half plane. In these cases, 
the upper (respectively lower) half plane is said to be transformed into 
itself. Similarly, the substitution f = I /2 transforms the right (resp>ec- 
tively left) half plane into itself, whereas f*' = --I /2 transforms the 
right into the left half plane, and vice versa. In a specific problem the 
particular form of the substitution chosen is thus seen to depend upon the 
detailed requirements set by the nature of that problem and the purpose 
for which the substitution or transformation is made. 

*The conclusions in this statement are reversed if the contour does enclose the origin. 
This fact may readily be appreciated from the study of a few simple examples. 



image = 1/5 as obtained by 
graphical construction. 
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The substitutions f = ±l/z are special cases of the more general 
linear fractional or bilinear form 


az + b 
CZ + d 


[488] 



Fig. 30. Corresponding circular loci of s and variou.s related reciprocak. Note the 
various senses of angular relationships. 


in tvhich the complex constants a, b, c, d are subject to the condition that 
the so-called determinant ad — be oi the transformation shall not vanish, 
that is, 

ad — be 7 ^ 0 [489] 


and, in addition, 


c ^ 0 


[490] 


The function 488 then is regular everywhere except at the one point 


2 = 



[491] 


at which it has a simple pole. 

Inclusive of this point, there is a unique correspondence between all 
points in the z- and f-planes, so that the inverse of the function 488 which 
reads 

di -b 

z =- 

-cf + a 



has identical mapping properties. 
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The condition 490 is necessary in order to prevent 488 from degenerat¬ 
ing into an ordinary linear form* The reason for the condition 489 is 
appreciated through consideration of two points fi and f 2 in the f-plane 
and their corresponding points Zi and Zz in the 3-plane. Equation 488 
then yields 


(ad — bc)(zi — zz) 
(czi -f" d)(czz “f- d) 


[493] 


whence it is cleax'that a unique correspondence of points does not result 
if ad — = 0. 

In addition to fi and f 2 , two more points fa and f 4 together with their 
corresponding points Za and Z 4 are now considered. By analogy to the 
form of Eq. 493, it is then readily seen that 

fa - f 1 ^ S3 - zi ^ CZ 2 + d 

fa ~ fa Z3 — Z2 czi -f- d 

and 

f 4 ~ fl _ S4 ~ Si ^ CZ2 + d 

f4 ~ fa Z4 — Z2 czi -j- d 

and hence that 

fa - fl / f 4 - f 1 ^ S 3 - zi / S 4 - Si 
fa ~ fa/ f 4 ~ fa S 3 — Z 2 / S 4 — Z 2 

With reference to Fig. 31 it is clear that 

Z 3 - Zj ^ 1^3 - gj I 
23 — Z2 \Z 3 — Z2I 

and 

g4 ~ 2 l ^ \Z4 - Zi\ 

Z 4 - S 2 k ~ Z 2 I 

Now if the points Zi, Z 2 y 23 , 24 are assumed to lie on a circle, it follows 
that a = 0. The right-hand side of Eq. 496 is then seen to reduce to a 
positive real constant. Since, according to a familiar geometrical proposi¬ 
tion, the angles a and 0 can be equal only if the four points in question 
he on a circle, and since, according to Eq. 496, a similar geometrical 
relationship to that shown in Fig. 31 likewise applies to the quantities 

*The mapping properties of the linear transformation w az -{• b are recognized as 
amounting to a magnification and rotation according to the magnitude and angle of the 
complex constant a, and a translation equal to the value of b. Any picture or map subjected 
to this transformation obviously remains undistorted. The mapping properties of the linear 
transformation arc, therefore, said to be homographic* 


[494] 

[495] 

[496] 

[497] 

[498] 
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fi, f 3 , f 4 , one may conclude that the corresponding points fi, fj, fa, ^4 
must also lie on a circle. An important property of the transformation 
488 or its inverse 492 is thus proved, namely, that this linear fractional 
form carries circles over into circles. In other words, a circular locus in the 
s-plane corresponds to a circular locus in the f-plane. Straight lines are 
included here since they represent circles with infinite radii, but it is not 
implied, of course, that straight lines are 
necessarily carried over into straight lines. 

The linear fractional transformation is, in¬ 
cidentally, the most general analytic trans¬ 
formation yielding a one-to-one correspond¬ 
ence between all points in the simple w- and 
2 -planes. The term “ simple ” w- or 2 -plane is 
intended to denote such a one in which the 
unique distinction between points does not 
require the concept of a multileaved ,Rie- 
mann surface. With the interpretative aid of 
such a surface, any analytic function yields Construction used 

a one-to-one correspondence between points fractional transformation 
in the w- and s-planes. In the simple complex carries circles over into 
plane however schlichte Ebene in the circles. 

German literature), a one-to-one correspond¬ 
ence between ix)ints is afforded only by the so-called schlicht functions, 
of which the linear fractional function is the most general form. 

The fixed points of the transformation are those for which f = s, 
or, Eq. 488 being used, they correspond to the z-values satisfying the 
equation 

az + I 

^ = — Tl 
cz a 

which is equivalent to 

cz^ + {d — a)z — h = 0 [500] 

The roots of this quadratic equation may be denoted by zi and 22 * Then 
fi = 2 i and f 2 = S 2 [501] 

If the f-plane is superimposed upon the 2 -plane, any circle passing 
through the points 21 and 22 is transformed into another circle passing 
through these same points. Hence the family of circles passing through 
the fixed points zi and 22 is.transformed into itself in the sense that any 
one of these circles is transformed into another belonging to the same 
family. Now these circles possess an orthogonal family of loci which are 
also circles. These enclose the points 21 and 22 , as shown in Fig. 32. Since 
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the transformation is a conformal one, it follows that the transformation 
of an orthogonal circle must also be orthogonal to any of the circles 
through Si and S 2 . Hence the family of orthogonal circles is transformed 
into itself also. 



F*ig. 32. Circles through the fixed points Zi and So are transformed into other circles 
through the same two fixed points. 


For proper choices of the constants in Eq. 488, this transformation 
may be made to carry any specified circle in the z-plane over into an 
independently specified circle in the f-plane. In order to see this one may 
write by analogy to Eq. 496 

r - ri / ^3 - ifi ^ Z- Z i 

f ~ fz/ fa ~ fz z — Z2 

in which Z], Z 2 , 23 are distinct and z is a variable point on a given circle 
in the z-plane, whereas fi, ^ 2 , fa. and f are the corresponding distinct 
and variable points on the resulting circle in the f-plane. If one writes 
for the sake of abbreviation 


n. 


Zz — Zi 


S3 ^2 


[502] 


fj — ^3 ~ Tl / ^3 — gj 
^3 ““ fs/ 2?3 — S 2 


[503] 


Eq. 502, which is equivalent to the transformation 488, takes the form 




s — 2 i 


[ 504 ] 


S — Z2 



Art. 24] 


THE UNEAR FRACTIONAL FUNCTION 


367 


Here Zi, Z 2 , zs are any distinct points determining a specific circle in the 
z-plane, and fi, f 2 , fa are any chosen corresponding points in the f-plane 
determining a circle which the desired transformation is intended to 
yield. 

In particular, the points Zj and Z 2 in Eq. 503 may be selected as the 
fixed points of the transformation. Then fi = zj and f 2 = Z 2 , so that 


fa - 22 / 23 - Z 2 


[505] 


Equation 504 then reads 

f - 2l ^ 2 - 2i 

f — Z 2 Z — 22 


[506] 


This is called the normal form of the transformation 488 or its inverse 
492. 


Two special types of this transformation may now be defined. For the 
first of them, any member of the family of circles passing through the 
fixed points zi and Z 2 is transformed into itself. This statement means 
that the points Z 3 and fa lie on the same circle, although thQr are, of 
course, not coincident like the points = Zi and fa = 22 ; otherwise the 
transformation would degenerate into the trivial identity f = 2 . The 
points Zi, 22 , 23 , fa are then four distinct points on the same circle, like 
the four points Zi, Z 2 , 23 , 24 in Fig. 31. According to the reasoning which 
shows the right-hand side of Eq. 496 to be a positive real constant, it 
follows from the similarity between the right-hand sides of Eqs. 496 and 
505 that H is a positive real nonvanishing constant. This then is the condi¬ 
tion for which the transformation 506 (or its equivalent 488) carries any 
circle through the fixed points Zi and 22 over into itself. This type of the 
transformation is designated as hyperbolic. 

The second special t)T)e has the property that any one of the orthogonal 
family of circles enclosing the fixed points is transformed into itself. In 
order to recognize the condition which yields this result, one must recall 
that any circle enclosing the fixed points is, according to well-known 
principles in analytic geometry, defined as the locus of a point for which 
the ratio of its distances from the two fixed points (or poles) remains 
constant. If z denotes a variable point on such a circle. 


z — Zi 
2 — Z2 


= constant 


[507] 


The condition that the transformed point f shall lie on the same circle 
evidently reads 


f - 2i 


2 — 21 

f — 24 


Z — So, 


[ 508 ] 
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which, with regard to Eq. 506, means that 

|H| = 1 [509] 

The parenthetic statement H 5 ^ 1 is intended again to rule out the 
trivial case f == 2 . This special type of the transformation is designated 
as elliptic. 

With regard to the further general properties of the linear fractional 
transformation given by Eqs. 488 or 506, it is useful to recognize that 
this transformation not only maps the points on a given circle in the 
z-plane upon a corresponding circle in the f-plane, but also furnishes a 
one-to-one correspondence between all points within those regions of the 
2 - and f-planes bounded by these circles. In other words, the transforma¬ 
tion is said to map one of these regions upon the other. 

Now a circle may be considered to be the boundary either of the region 
enclosed by it, or of the complementary region which lies outside it. In 
order to remove this ambiguity, and also to furnish a clearer visualization 
of how the mapping of corresponding regions is effected by the trans¬ 
formation, one may consider a specific circle K in the 2 -plane and the 
corresponding circle C in the f-plane. The points Si, Zz, 23 lie on the circle 
K, and the respectively numbered corresponding points fi, fs he on 
the circle C. In the order in which they are numbered, the points in each 
set form a sequence which fixes a definite direction of traversal (clockwise 
or counterclockwise) around their respective circle. In this way, corre¬ 
sponding reference directions of traversal are fixed for the two circles K 
and C. It is clear from the preceding discussion that a variable ix)int 
following along the circle K in its reference direction is transformed into 
a point which follows along the circle C in the corresponding reference 
direction. 

One may now imagine that at some point z the variable point following 
along K suddenly leaves this circular boundary by making a right-angle 
turn to the left. According to the principle of conformality, the corre¬ 
sponding variable point on C must likewise make a right-angle turn to the 
left at the point f corresponding to z. If one imagines a second circle 
in the 2 -plane lying wholly within the region to the left of K, with a diam¬ 
eter which differs from that of K by a small amount, this line of reasoning 
shows that the corresponding circle C' in the f-plane lies wholly within 
the region to the left of C. Continuing this process of reasoning (by 
applying the same line of thought to the circles K\ C and a pair A"", C" 
lying wholly within the regions to the left of A' and C', etc.) one finds it 
clear that the entire region to the left (or to the right) of K is mapped 
upon the region to the left (or to the right) of the circle C. 

If the reference directions of traversal around the circles A and C are 
the same (both clockwise or both counterclockwise), the region inside 



Art, 24] 


THE LINEAR FRACTIONAL FUNCTION 


369 


(respectively outside) K is mapped upon the region inside (respectively 
outside) C, whereas if the reference directions are opposite, the region 
within K is mapped upon the region outside C, and vice versa. 

As an illustrative example, let it be required to find the function 
which will map the region inside the unit circle about the origin upon the 
region outside the unit circle. Since the unit circle forms the common 
boundary for the two regions in question, one must look for that linear 
fractional transformation which transforms the unit circle into itself. 
If the reference direction of traversal for the unit circle in the z-plane is 
assumed to be counterclockwise, whereas for the unit circle in the f-plane 
it is assumed to be clockwise, the regions to the left of these boundaries 
in the z- and f-planes are those which are to be mapped uix)n each other. 
With these rx)ints in mind, the normal form for the required transforma¬ 
tion is readily established. 

In Eqs. 505 and 506 one may choose the following correspondence of 
points: 


Si = +1 S2 = -1 Z3 = -j 

fi = +1 r2 = fa = +j 


[510] 


This makes s = ±1 corresiX)nd to the fixed points. Substituting into 
Eq. 505, one finds 


H 


7 + 1 / + 1 


[511] 


so that the normal form of the required transformation, according to 


Eq. 506, becomes 




f - 1 2-1 

f + 1 2+1 

[512] 

This is equivalent to 




1 

f = - 

Z 

[513] 


which is the simple transformation discussed earlier in this article, and 
evidently yields the desired mapping relationship. By choosing different 
sets of corresponding points which nevertheless satisfy the condition of 
opposite reference directions around the unit circle, one may find in¬ 
numerable additional transformations which also map the inside of the 
unit circle upon the outside. It is, of course, not necessary that two of the 
chosen points be the fixed points of the transformation, since Eqs. 503 
and 504 apply to any arbitrary sets of corresponding points. 

As a second example, let it be required to find the substitution which 
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maps the inside of the unit circle in the 2 -plane upon the upper half of the 
f-plane. According to the principles discussed above, the following 
corresponding sets of points may be chosen: 

2i = 4-1 2a = —1 23 = —j 

fj = +1 fa = -1 fa = 0 [514] 


The unit circle in the 2 -plane is traversed in the counterclockwise direc¬ 
tion from -|-1 around to — 1 and through —j back to -H1; the real axis in 
the f-plane is traversed from -|-1 through the point » to — 1 and thence 
through the origin back to -|-1 • The regions to the left of these boundaries 
are those which are to be mapped upon each other. Substituting into 
Eq. 505, one finds 


H = ^ / -/-! _ 1-y 
1 / -y-f 1 1 -hi 


-3 


[515] 


so that the norm 2 il form of the desired transformation becomes, according 
to Eq. 506, 


f - 1 
f + 1 



[516] 


This is equivalent to 


f = -7 


.2 -t-y 


or 


z=j 




f+y 


[517] 


Here the points 2 = ± 1 again are the fixed points. 

Alternatively one may solve the present problem by assuming the 
corresponding sets of points 

2l = -t-1 22 = +y 23 = —1 

fi = — 1 f 2 = 0 fa = +1 [518] 


None of these are fixed points. Consequently the forms 503 and 504 must 
be used. According to Eq. 503, 




Substituting this into Eq. 504, one finds 


f = -j 


.2 


2 -i-y 


or 


2 = 


*^f+i 


[519] 


[520] 


Comparison with Eq. 517 shows that these results are identical except 
that z is replaced by — s. 

From the nature of this problem it is obvious that Eqs. 517 or 520 still 
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constitute solutions if z is replaced by ze^*, where <l> is any chosen angle. 
For example, replacing z in Eq. 517 by —jz yields another possible 
solution, namely, 


f =y 


. 1-2 


or 


1+2 

This has the corresponding points 

2 = + 1 , +/, 

f = 0, +1, 


j + i 

[521] 

-1, -j 

00, -1 

[522] 


Again none of these are fixed points. The point z = — 1 here corresponds 
to the point « in the f-plane. In the transformation 517 the latter 
corresponds to the point z = j\ in Eq. 520 the pwint z = —j corresponds 
to {• = 00 . Evidently the present problem may be solved with any 
desired point on the vmit circle in the z-plane corresponding to the point 
00 in the f-plane. 

Alternatively, one may for example map the right half of the f-plane 
upon the inside of the unit circle in the z-plane. The transformation 
which yields this result is obtained from any of the solutions to the pre¬ 
ceding example by replacing f by^f. This change amounts to making the 
substitution f' = —ji and subsequently writing f for f' again (a substi¬ 
tution which rotates all points by 90 degrees in the negative direction). 
Applied to the Eqs. 521, for example, this process yields 


f = 


1 — z 
1+2 


or 


1-r 
1 + 


[523] 


for which a set of corresponding points are 

2 = +1, +j, —1, —j 

f = 0, -y, 00, +y 


[524] 


It is observed that these are the same points as those in the set 522 except 
that the f-points are rotated 90 degrees in the negative direction, so that 
the imaginary instead of the real axis becomes the boundary of the 
mapped region in the f-plane. 

It is instructive to study the conformal maps of one of these functions 
in somewhat greater detail. The transformation 523 is particularly in¬ 
teresting in this respect, since it is perfectly symmetrical in the variables 
z and f. Figure 33 shows how a system of concentric circles about the 
origin in the z-plane, along with the orthogonal family of radial lines, 
are mapped in the f-plane. The origin in the z-plane becomes the point 
+ 1 in the f-plane. The concentric circles within the unit circle of the 
s-plane become eccentric circles about +1 in the f-plane, the unit circle 
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itself corresponding to the imaginary axis of the f-plane. The radial lines 
within the imit circle of the 2 -plane become those portions of the orthogo¬ 
nal circles through the points rt 1 which lie in the right half of the f-plane. 
The circles of the a-plane (shown dotted) which are larger than the unit 
circle become eccentric circles in the f-plane about the point —1, and 
the portions of the orthogonal circles through the points f = ±1 which 
lie in the left half of that plane (also shown dotted) correspond to those 
portions of the radial lines in the a-plane lying outside the unit circle. 



(a) (b) 

Fig. 33. Map of the interior of the unit circle in the z-plane to the right-half f-plane 
by the transformation z = (1 — f)/(l -I- f). 

A more comprehensive view of this situation is gained through recog¬ 
nition that the points 1 and —1 of the f plane are transformed into the 
origin (south pole) and the point «> (north pole), respectively, of the 
complex sphere associated with the 2 -plane. In other words, the poles of 
the complex sphere associated with the 2 -plane are transformed into the 
finite points ±1 of the f-plane, and the resulting map in that plane 
represents the corresponding distortion suffered by the concentric circles 
and radial lines in the 2 -plane which accompanies this shifting of the 
poles. This interpretation is responsible for the term “ bipolar circles ” or 
“ bipolar plot ” by which the map in the f-plane is also known. 

Since the forms 523 are symmetrical in the variables z and f, it follows 
that the sets of orthogonal loci in the z- and f-planes of Fig. 33 may be 
interchanged. That is, if concentric circles about the origin together with 
the family of radial lines are drawn in the f-plane, the corresponding map 
in the 2 -plane becomes that which in Fig. 33 is shown for the f-plane. 
In other words, the transformation 523 may alternatively be said to map 
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the inside of the unit circle in the f-plane upon the right half of the 
js-plane. 

A word of caution may be appropriate at this point in order to guard 
the reader against confusing part (b) of Fig. 33 with the similar appearing 
plot of Fig. 32. In the latter, the poles Si and Z 2 are the fixed points of the 
transformation. Figure 33(b), on the other hand, is not the corresponding 
plot for the transformation 523, since the fixed points in this case are 
evidently not the points f == it 1. The maps in Fig. 33 are merely a pair 
of corresponding sets of curv^es chosen to illustrate the way in which the 
region enclosed by the unit circle is mapped upon the right half plane, 
and these curves have nothing in conunon with the type of plot shown in 
Fig. 32. The reader may further clarify his thoughts on this score by 
determining the fixed points of the transformation 523 and by subse¬ 
quently drawing loci of the type shown in Fig. 32. 

In connection with the preceding general discussion it is relevant to 
add the following remarks regarding several collaterally useful properties 
of the linear fractional transformation. It should readily be appreciated, 
for example, that the end result of carrying out two different linear 
fractional transformations in succession can also be had from a single 
one. More specifically, if the relation 


iiiz 4- h] 

CiZ + di 


[525] 


represents a transformation from the variable s to a new variable z', 
and 


G 2 Z ~f“ bo 
C2Z ”f" d'y 


[526] 


represents a succeeding transformation to still another variable z", 
it is always jxissilde to relate to c directly by a transformation of the 
same form, namely, 

^ GZ + h 
cz d 

The truth of this statement follows immediately from the consideration 
that the linear fractional form carries circles over into circles and con¬ 
versely that any univalued analytic transfonnation of circles into circles 
is linear fractional (see footnote on page 375). Thus, two such trans¬ 
formations applied in tandem obviously accomplish no more than can be 
accomplished by a single one.* 

^Because of this property the totality of possible linear fractional transformations is said 
to form a group. 
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The coefficients c, b, c, d in the single resulting transformation 527 may 
be determined from the coefficients in the two separate transformations 
525 and 526, through substituting the relation 525 for into Eq. 526 and 
putting the result into the form of Eq. 527. One finds that 

d — 02^1 H" ^2^1 

h — Q^bi *1“ b2di 

. c — C 2 O 1 "b d 2 Ci 

d — C2^1 "b <^2^1 

It is interesting (as well as relevant in dealing with circuit problems 
involving a cascade of transmission networks) to observe that the rela¬ 
tions 528 may be expressed more compactly by means of the single 
matrix equation 

Another interesting fact is brought out when the linear fractional 
transformation, Eq. 488, is put into the form 


[530] 


as is always possible so long as the conditions 489 and 490 are fulfilled. 
In view of this form, one may regard the arbitrary linear fractional 
transformation as equivalent to carrying out in succession the simpler 
transformations indicated by 


/ = z + - 
c 

[531] 

II 

[532] 


[533] 


The first of these component transformations represents a displacement, 
the second is a simple inversion, and the third represents a magnification 
and rotation (multiplication by a complex constant) followed by a dis¬ 
placement. Since each of these component transformations carries circles 
over into circles, one arrives again at the conclusion that the linear 
fractional transformation has this property. 
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Finally, an interesting correlation with the process of stereographic 
projection may be mentioned. As pointed out in Art. 4, this geometrical 
process is one whereby every finite point in the complex 2 -pIane has 
uniquely associated with it a point on the so-called complex sphere which 
is tangent at the origin. If a second plane (f-plane) is imagined to 
be tangent to the same sphere at some other point, and if the same 
geometrical process is used to associate points on the sphere with points 
in the second plane, it is evidently possible to state that the system con¬ 
sisting of the two planes and the sphere, together with the geometrical 
process of stereographic projection, enables one to associate uniquely a 
point z in one of these planes with a corresfK)nding point f in the other 
plane. 

It is of interest to show how the transformation implied by this process 
can be expressed analytically in terms of the linear fractional function 
488.* Although the converse of this statement is not generally true, it is 
worth noting that some of the linear fractional transformations en¬ 
countered in practical problems may be interpreted geometrically in this 
simple fashion. 

In order to develop the appropriate analytic relationships, one may 
begin by visualizing a sphere of diameter D and any two tangent planes 
(the z- and f-planes). The two points of tangency determine uniquely a 
great circle on the sphere. The plane containing this great circle is con¬ 
veniently chosen as a cross-sectional plane in which to indicate graphically 
further pertinent geometrical relationships. Figure 34 shows the system 
as viewed in this plane, to which the z- and f-planes are both orthogonal 
and hence appear as lines. The two polar axes, which are diameters of the 
sphere and are normal to the z- and f-planes at their respective points 
of tangency, make an angle with each other which is denoted by y. 
The real and imaginary axes in the z- and f-planes have orientations which 
at the moment may be considered to be arbitrary. 

The points in the f-plane corresponding to z = 0 and z = oo are 
denoted by fo and f«,, respectively, whereas those in the z-plane cor¬ 
responding to f = 0 and f = <* are denoted by z© and z«,. These four 
points lie in the plane of the polar axes, and their locations in the z- and 
f-planes are shown in Fig. 34. From the geometry it is readily seen that 

Izol = Ifol =-Dtan^ [534] 

*The p)Ossibility of doing so should be evident from the geometrical proposition that the 
process of stereographic projection carries circles in the plane over into circles on the sphere, 
and vice versa. Hence a circle in one of the planes is transformed into a circle in the other 
plane. Any univalued analytic transformation which carries circles over into circles is expres¬ 
sible in terms of a linear fractional function. 
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and 


|z«,| = If-I = £>cot^ [535] 

in which the absolute value signs are necessary because the lines repre¬ 
senting the z- and f-planes in Fig. 34 are not necessarily coincident with 
the real axes in these planes. 



Fig. 34. In many cases, a linear fractional transformation may be visualized as 
a twofold stereographic projection in terms of two planes tangent to the same complex 

sphere. 


With reference to the linear fractional function 488 and its inverse as 
given by Eq. 492, it is expedient in the subsequent considerations to 
observe that only three of the four constants a, ft, c, d are independent, 
since the right-hand members of these relations have the same value if 
their numerators and denominators are multiplied by a common (finite, 
nonzero) factor. Inasmuch as it is assumed that c 5 ^ 0, one may choose the 
constant 1 /c as this common factor, or, what amounts to the same thing, 
arbitrarily set c equal to unity. Equations 488 and 492 then yield the 
results 

Zco = -d [536] 


and 


Zo == - 


fo = 


d 




[537] 
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Comparison with Eqs. 534 and 535 shows that 

|o| = |d| = Z? cot ^ [538] 

and 

|6| = [539] 

Referring to Fig. 34, one recognizes that the angles of the complex 
quantities zq and (in the complex z-plane) must differ by v radians 
and that the same is true for the quantities fo and f .. In view of Eqs. 
536 and 537, this fact yields the conclusion that 

must be a negative real number [540] 

This result, together with the condition that |a| = \d\, represent the 
restrictions which must be imposed upK)n a given linear fractional function 
in order that it may jx)ssess the simple geometrical interpretation dis- 
cussed here. For any given linear fractional function fulfilling these con¬ 
ditions, the diameter of the sphere and the angle y between the polar 
axes are given by Eqs. 538 and 539, whereas the orientations of the real 
and imaginary axes in the z- and f-planes are obtained from Eqs. 536 and 
537. Thus the correspcmding geometrical configuration is determined. 

Conversely, if the geometrical configuration for the sphere and the tw'o 
tangent planes is given, and one wishes to find the corresponding linear 
fractional function, three of the relations contained in Eqs. 536 and 537 
may be used to determine the complex constants a, 6, and d. The magni¬ 
tudes of these constants must, of course, agree with the values given by 
Eqs. 538 and 539. This determination is always possible. 

As an illustration it is interesting to consider the transformation 523 
by means of which the interior of the unit circle in either plane (s or f) is 
ma{)ped uix)n the right half of the other plane. By inspection of Eqs. 523 
one sees that 


a=—1 6=1 rf=l 

[541] 

and also that 


2o = 1 = —1 

i-o = i r-=-1 

[542] 

These values are consistent with Eqs. 536 and 537 as, 
should be. From Eqs. 538 and 539 one obtains 

of course, they 

Z?=l 7 = ^ 

[543] 
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The transformation in question is, therefore, given geometrically 
(according to the present interpretation) by means of a sphere of unit 
diameter and a pair of tangent planes which are normal to each other as 
well as normal to the plane containing the polar axes. This configuration 
is shown in Fig. 35. Although the values 542 uniquely determine the 
relative orientations and positive directions for the real axes in the s- and 
f-planes, the positive directions for the imaginary axes are not uniquely 
fixed, because all these values are real. If the imaginary axis for the 

s-plane is assumed to point vertically 
upward from the plane of the paper in 
Fig. 35, and the unit circle in the 
s-plane is traversed in the counter¬ 
clockwise direction so as to keep the 
interior on the left, then, since the im¬ 
aginary axis in the f-plane must be 
traversed in such a direction as to 
keep the right half plane on the left, 
one observes that the imaginary axis 
for the f-plane points vertically into 
the plane of the paper in Fig. 35. 
This choice for the positive directions 
of the imaginary axes places the top faces of the s- and f-planes op- 
px)site the sphere. It is alternatively possible to assume both {X)sitive 
directions for the imaginary axes reversed, w^hence the top faces of the 
planes appear adjacent to the sphere. 

To anyone who has developed a facility for visualizing geometrical 
objects in three dimensions, this interpretation for the transformation 523 
affords a useful means for correlating its various detailed characteristics. 

25. A MORE GENERAL MAPPING FUNCTION; THE ScHWARZ- 
ChRISTOFFEL FORMULA 

The principal field of usefulness with regard to conformal mapping is 
found in connection with problems in potential theory. When the geome¬ 
try of the physical system exhibits longitudinal uniformity in one of its 
dimensions, the problem reduces to a two-dimensional one. As shown in 
Art. 5, the real and imaginary parts u and v ol a. function of a complex 
variable satisfy Laplace's equation in two dimensions and hence represent 
potential functions. Since the loci for u = constant and v = constant 
form orthogonal families, they may be regarded as the equipotential and 
flow lines of a nonturbulcnt field, that is, of a pure potential field. If a 
pair of such functions can be found whose loci conform to the geometrical 
boundaries of a given physical system, the solution to the boundary 
value problem for that system is thereby given. 



Fig. 35. Visualization of the trans¬ 
formation 2 ~ (1 — t)/( 1-f r) as a 
twofold stereographic projection. 
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For example, Poisson’s integral, Eq. 323 or Eq. 324, yields the potential 
inside a circle in terms of specified boundary values. This integral, there¬ 
fore, constitutes a solution to the boundary value problem for the circle, 
the specific forms given by Eqs. 332 and 333 expressing this solution as a 
sum of exponential functions. 

By means of a function which conformally maps the interior of a circle 
upon a region having a different geometrical configuration, the boundary 
value problem for that configuration may be transformed into an equiva¬ 
lent one for the circle, and the desired solution is found through applying 
to the solution for the circle, the inverse transformation. 

The boundary is commonly an equipotential locus, so that the sp)ecifica- 
tion of boundary values amounts merely to stipulating that the potential 
function shall be constant on the boundary. In electrical problems, this 
boundary is the surface of a conductor or of a material having a large 
pxjrmeability relative to that of the surrounding medium. The solution 
to the boundary value problem for the circle then consists simply of 
concentric circles for the equipotential loci, with the orthogonal radial 
lines representing the flow field. The origin, or center of the circle, and 
the point at infinity represent the source and sink for this field. 

An even simpler geometrical configuration is given by a pair of bounda¬ 
ries in the form of parallel lines. When these are constant potential loci, 
the flow map consists of a rectangular grid of flow lines and equipotential 
lines. Such a rectangular region is mapped upon the interior of the circle 
by means of the function 

s = or / = In 2 [544] 

Writing 

z = and / = m + jn [545] 

one finds from Eq. 544 that 

w = In r and n <t> [546] 

If the origin (r = 0) and infinity (r = oo ) in the s-plane represent the 
source and sink for the field, the radial flow enclosed by a pair of lines 
</> = </>! and 0 = 02 (these may be 0 = 0 and 0 = 2ir) is mapped upon 
the /-plane as a parallel flow enclosed by the straight lines n = 0i and 
n = 02 . The equipotential loci, which in the 2 -plane are the circles 
r = constant, become the straight lines m = constant, which are at right 
angles to the flow lines n = constant. Source and sink become the points 
w = rb CO. These matters are illustrated in Fig. 36. The rectangular flow 
map in the /-plane may be regarded as a reference field (a flow map of the 
simplest type) to which the radial type of flow map is transformed by the 
function 544. 
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Inasmuch as the upper half of the a-plane may be confonnally mapped 
upon the upper half of the f-plane, according to the discussion of the 
previous article, with any two desired points* on the real axis of one 
half plane corresponding to the origin and infinity in the other, it follows 
that a flow map in the upper half plane, with any two points on the real 
axis designated as the source and sink, may be reduced to the reference 
field in the /-plane of Fig. 36. If transformations can be found which map 
regions having other geometrical configurations for their boundaries, 
upon the upper half plane, or upon the region enclosed by the unit circle, 
a way is established for also reducing the flow maps for these configura¬ 
tions to a simple rectangular reference field, thus making possible the 
solution to boundary value problems in these more complicated cases. 



Fig. 36. Transformation of a radial flow map to a simpler flow pattern by the 

transformation z = e‘. 


An extremely useful mapping function, of considerable generality in 
its ability to meet various geometrical configurations, is given by the 
so-called Sckwarz-Christqffel formula, which reads 

w{z)= M r (f - ■ - (f - Zn)-'^dt -h N [547] 

Here f is a running variable in the z-plane, zj, 02 , • • • Zn are n finite points 
on the real axis, numbered in such an order that 

Zi < Z 2 < ■ • • < z„ [548] 

and the quantities uuHz,--- Un appearing in the exponents are any set of 
positive or negative real numbers. The constants M and N may have 
complex values, with the possibility that N be zero, but M must, of 
course, have a nonzero value. The lower limit Zo of the integral is an 
arbitrary point in the upper half plane. It may be chosen equal to zero, 
or equal to one of the points Zi • • • z„. The principle guiding this choice is 
best seen from the illustrative examples given subsequently. 

*A third point (for example, midway between the other two) may be chosen to correspond 
to the point -fl (which lies between the origin and infinity). 
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The indepiendent variable for the mapping function ■w{z) is the upper 
limit of the integral. For this reason the derivative of the function is 
given by 

^ = M(z - 2i)-«(z - Za)-^ • • • (Z - [549] 


as may be seen from the fact that if one has 

= r /(f) dt 

t/«o 


the usual definition for the derivative 

dw , Yw{z -f Asr) — w{z) 

— = limit - 

az A 2 —K) L As 


] 


yields 


w(z + Az) — u/(z) = /(f) df 


[550] 

[551] 


[552] 


Since As is a small displacement (becoming zero in the limit), one may 
say that for the integration in Eq. 552 the function/(f) is essentially 
constant and equal to the value /(s). It is assumed, of course, that the 
function/(f) is continuous in the vicinity of the point f = z, which is a 
recognized condition for the existence of the derivative in the first place. 
With/(f) equal to the constant value/(3), it may be placed in front of the 
integral sign, and Eq. 552 yields 

/ r-f-Az 

= /(z) ^ [553] 


the approximation becoming exact in the limit Az —»0. Completing the 
limit, one finds, therefore, that 

[554] 

The essential character of the function u>(z) may now be recognized 
from a study of the behavior of the derivative 549 in the vicinity of the 
points z = z,. The first step in this direction is to represent the factor 
(z — Zy) in the polar form as illustrated in Fig. 37. This representation 
reads 

(z — Zk) = \z — [555] 

in which ^ is an integer. 

Then 


(z - Zy) ^ = Z - Z|>| Rl‘y‘^y+Zrkli^ 


[556] 
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Since the quantity n, is not necessarily an integer, the right-hand side of 
Eq. 556 may have many different values for different integer values of k. 

In order to remove this multivaluedness of 
the factor (z — z, it is specified at the 
outset that k shall assume only the value 
zero. This specification is equivalent to 
stating that the function dw/dz is to be 
studied on only one of the many leaves of 
its Riemann surface, namely, on that one 
which corresponds to ^ = 0 in Eq. 556. A 
typical factor in Eq. 549 then becomes 

(z — z,)""” = \z — [557] 



Fig. 37. Representation of 
2 — z, in polar form in the 
study of dw/dz. 


and if the point z is allowed to lie only in the upper half plane or on the 
real axis of the z-plane, it is clear from Fig. 37 that 


When the polar forms 
and 


0 ^ <t>, ^ r 


dw 

dz 



[558] 

[559] 

[560] 


are introduced, it follows that 

6 = a — fJLi(t)i — fJL2<f>2 — • • • — [561] 

It is now assumed that the variable z in the function 549 is restricted to 
real values only; that is, the variable point z is thought of as moving along 


2-plane 



Fig. 38. The path along which dw/dz is studied in the Schwarz-Christoffel trans¬ 
formation. 


the real axis from — oo to oo , the only deviation from this behavior occur¬ 
ring wherever the variable point z encounters one of the critical points 
z,. There it makes a slight detour around the critical point instead of pass¬ 
ing directly through it. These detours may be visualized as having the 
form of vanishingly small semicircular arcs lying in the upper half plane, 
as shown in Fig. 38. As the point z traverses a small semicircular arc in 
the vicinity of the point z„ the angle <t>, changes from the value t to zero. 
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whereas the angles of the remaining factors do not change at all because 
of the assumed vanishingly small radius of the semicircular detour. 
Hence for the range 

<z< z^i [562] 

one has 

<t>i=<l>2= ••• =^|^_l=0 IT^0,^0 <)>»+i=4>i>+2— •** [563] 

and* according to Eq. 561 

a—+ ’ • • +/in)ir ^ 9 ^a—(; i»+i4-/«i.+ 2+' • *+/tn)T [564] 

Throughout the range 562, the angle 6 is, therefore, increased by the 
amount 

Ad = ixyir [565] 

the important feature being that this increment occurs only as the point z 
traverses the small semicircular arc. In other words, as the point z moves 
along the real axis, the angle 9 remains constant as z proceeds from one 
of the critical points to the next, receiving a sudden increment A$ = 
only as z passes directly over the critical point z,. 

According to the discussion of conformal mapping in Art. 2, it is recog¬ 
nized that the map of the function ui(z) in the az-plane, correspond¬ 
ing to the real axis in the z-plane, 
consists of a succession of straight- 
line segments between the points W'l, 
jt' 2 , • • • corresponding respectively to 
Z], Z 2 ,- • • , the angular directions of two 
consecutive segments confluent in the 
point w„ dilTering by That is, the 
map in the w-plane of the function 
547, corresponding to the real axis in 
the z-plane, traversed from — «> to «, 
has the general character shown in 
Fig. 39. This result follows from the 
fact, pointed out in Art. 2, that the 
angle of dw/dz equals the difference be¬ 
tween the angles of the increments dzi> 
and dz, and since the angle of the latter remains zero as the point z 
moves along the real axis, the angle of dw/dz must equal that of dw. 
This angle, however, is shown to remain constant except when z passes 
over one of the critical quantities z,. At the corresponding points w, 
then, the direction of the increment dw suddenly changes by the 
amount n.n. 

*If n, is negative, the inequalities in Eq. 564 are reversed. 



Fig. 39. The map in the a'-plane 
of the real axis in the z-plane shown 
in Fig. 38. 
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The plot in the 2 £;-plane corresponding to the real axis in the 2 -plane 
is thus seen to be a polygon with the points Wi • • • as its vertexes. If 

+ M2 + * * * + Mn = 2 [566] 


the sum of the increments AO at the n vertexes Wi • • • Wn equals Iw, 
Since 2Tr equals the sum of the external angles of a closed polygon, it 
follows that when the condition 566 is fulfilled, the j)olygon is w-sicled. 
Unless one or more of the values of /ii • • • Mn are equal to or greater than 
unity, all the n vertexes of the polygon lie at finite points corresixinding 
to the finite values Zi ••• Zn on the real axis of the 2 -plane. The pioint at 
infinity in the 2 -plane corresponds to an ordinary point on the straight- 
line segment joining the vertexes Wn and ic'i. If a factor jxy has a positive 
value equal to or greater than unity, the corresponding vertex of the ix)ly- 
gon in the 7 ii»-plane lies at infinity. This circumstance is subsequently dis¬ 
cussed in detail. 

When the condition 566 is not fulfilled, the point at infinity in the 
2-plane also corresponds to a vertex, and the iX)lygon in the zc'-plane has 
w + 1 sides. In order to consider this possibility more fully it is neces¬ 
sary first to study the function w{z) in the vicinity of the jx)int 2 = oo. 
For this purpose it is convenient to make the substitution 

with z*y = —- [567] 

f Zy 


Then 


and 


(f - 2.)“^' = • (f* - 2*,) 


so that Eq. 547 takes the form 

l£/(^ _) M. ^ SMn 


(r* - 2 (f* - 2*2^- • • (r* - 2*„) 


df-VN 


[568] 

[569] 


[570] 


in which 


[571] 


The derivative reads 

^ _ M(z*i)*“ • • ■ (2*n)'‘’‘(2 *)^'“ 
dz* - (2* - - 2*2^ • • 


+M2+ * • * +Mn—2) 


(2’ 






[572] 


The point 2 = «» corresponds to 2 * = 0. For the vicinity of 2 * = 0, 
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Eq. 572 gives 


dw 

d? 




[573] 


Hence it is clear that the point s = oo yields a vertex at which the angular 
increment M has the value 

(2 — /ii — iU2 — • • • — p.n)Tr [574] 

This vertex also lies at a finite point in the 2 £^-f)lane unless the quantity 
(2 — — M 2 i^n) is equal to or larger than unity. It is obvious 

that the vertex does not exist if the condition 566 is fulfilled. 

In order to study the behavior of the function w in the vicinity of one 
of its vertexes, one may first write for the derivative 549 

— ~ {z — + ^l(- + ^ 2 ( 2 ^ ~ + * * * ] [575] 

az 


in which the bracket expression is a Taylor expansion for the function 
549 with the factor (z — missing, h'or this Taylor expansion, which 

is evidently possible because the function it represents is regular at the 
f)oint z = z,, the coefficient is certainly not zero. Hence assuming 
M,. < 1 the term by term integration of Eq. 575 yields 



ao(z - zj , ai(z - Zy) , 

i-T"::;- r 


— Mi» + 1 


+ 2 


+ Wy [576] 


For the immediate vicinity of the vertex at the point w == Wy, therefore, 
one has the representation 


_ .r M.+1 


^ + 


(Iq(z s.) 


1 - 


[577] 


This analysis shows that so long as m*- < 1, the function w(z) is regular 
in the vicinity of the vertex Wy. This vertex may have a variety of ap- 



Fig. 40. Appearance of vertexes of polygon in the w-plane with varying values 

of M. 


pearances depending upon the particular value of m.^ < 1- Some of these 
are shown in Fig. 40. The arrows on the line segments indicate the direc- 



386 


FUNCTIONS OF A COMPLEX VARIABLE 


(Ch - VI 


tion in which the contour of the polygon is traversed as the point z 
travels in the positive direction (from — » to + «) along the real axis 
of the s-plane. The region enclosed by the polygon, which is that on the 
left of the contour, is shown shaded. 

Part (a) of the figure shows the appearance of the vertex when 
0 < fi, < 1. Here the external angle has a positive value between zero 
and IT. Part (b), for which the external angle has a negative value be¬ 
tween zero and — x, corresponds to — 1 < /<, < 0. Part (c) shows the 
vertex for n. = .— I. Here the external angle equals — ir. Finally, part (d) 
illustrates the appearance of a vertex at which the external angle is less 
than —IT (that is, equal to the negative of a quantity which is larger 
than x). In this case the enclosed region involves a double-mapped 
portion. 

If /i, = 1, Eq. 575 yields 

^ = Ooiz — 2,)”* + fli + UaCz — S») + • • * [578] 

az 

and the integration then gives 

w= f dw = floln (z — Zr)+ «i(s — 2,)-h ^(z — z„)2-1 - h C [579] 

in which 

C = —ao In (zo — z^) — ai(zo — z^) — • • • [580] 

In this case the vertex w^, evidently lies at infinity, since the value of the 
right-hand side in Eq. 579 becomes infinite for z = Sp. Figure 41 shows 

how this vertex may be imagined to appear, if 
it is assumed that one is permitted to indicate 
infinity as a finite point. The enclosed region in 
this vicinity is null, since it is contained be¬ 
tween line segments which fall upon each 
other. In the finite region of the zc^-plane the 
appearance of a polygon with a vertex Wv of 
this sort at infinity is shown in Fig. 42. The 
vertex of Fig. 41 at infinity is seen to result from a pair of confluent line 
segments which are parallel and hence meet or intersect at infinity. 

When fXv has any value larger than unity, the corresponding vertex 
also lies at infinity. Figure 43 shows the appearance of a polygon with 
such a vertex. The external angle lies between t and 2t, and Hv has a 
value between 1 and 2. For = 2 the external angle equals 27 r. Analysis 
similar to the preceding then shows that the function w{z) has a simple 
pole at the point z = Zyin addition to having a logarithmic infinity there. 

In the light of the preceding discussion and interpretation it may now 


1 _ 

Wy 

Fig. 41. Appearance of 
the vertex when fi, — 1. 
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be stated by way of a summary that the function defined by the integral 
547 uniquely and continuously maps all points on the real axis of the z- 
plane upon the boundary of a polygon in the w-plane. Since its derivative 
as expressed by Eqs. 549 and 572 is regular at all points in the upper half 
of the z-plane inclusive of the point at infinity, it follows that this func¬ 
tion is regular and continuous throughout this entire half plane and is 
single-valued by virtue of the stipulation regarding the choice of values 
for the factors (f — z,It may be concluded, therefore, that the 
function also maps the entire upper half of the z-plane upon the region en- 



Fig, 42. Appearance of the polygon 
in the finite u;-plane when one of its 
vertexes corresponds to = 1, 


Fig. 43. Appearance of the polygon in 
the finite w^-plane when one of its 
vertexes corresponds to > 1. 


closed by the polygon in the zo-plane, for any closed boundary lying wholly 
inside the {xjlygon must by reason of the continuity and single valuedness 
of the function also lie wholly within the uf)})er half of the z-plane. The 
availability of this mapping function and that represented by the linear 
fractional form discussed in the preceding article greatly enhances the 
means for solving two-dimensional boundary value problems, as is illus¬ 
trated by the following examples. 

The first problem to be discussed is the determination of the field dis¬ 
tribution in the vicinity of the edges of a parallel-plate condenser. Since 
the distortion of the field (“ fringing ”) is confined to the more im¬ 
mediate vicinity of the edge, the plates may be assumed to be infinitely 
wide, and since the field distribution is symmetrical about a center line 
between the plates, it is sufficient to map the field on one side of this center 
line only. The region over which a field map is desired may, therefore, 
be sketched as shown in Fig. 44. The edge of the condenser plate is at the 
point C above the origin of the u^-plane. The plate itself is j)arallel to the 
real axis of this plane and extends infinitely far to the left. The real axis 
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represents the center line between the plates, so that the distance d 
equals half the spacing between them. 

I'he shaded area, throughout which the field map extends, is regarded 
as the region enclosed by a polygon which has three vertexes. One of 

these lies at the finite point C, and 
the other two lie at infinity. One of 
these latter two results from the 
region A with its parallel boundaries 
extending to infinity on the left. This 
one, which may be designated as 
“ vertex A," evidently has the char- 
Fig. 44. Relevant to determining the ^cter of the vertex at infinity for the 

field of a parallel-plate condenser. polygon of Fig. 42. The Other vertex 

at infinity, which may be designated 
as “ vertex S,” has the character of the vertex uv in Fig. 43 for = 2. 
It represents the infinite extension of the region B to the right and upper 
left of Fig. 44. 

The electric flux being considered as the fluid, the flow in the parallel- 
plate condenser is from one of its plates to the other, whereas the equipo- 
tential loci are the orthogonal curves symmetrically grouped about the 
center line. However, from a mathematical standfwint it is equally 
admissible to consider the flow in the space between the plates to be in 
the general direction along the center line, with the cquipotential loci 
extending from one plate to the other. In other words, the flow map 
consisting of orthogonal families of loci depends only upon the geometrical 
configuration of the boundaries, and hence it makes no difference which 
of the families of curv'es is thought of as representing the flow of a physical 
fluid. In the present instance it is convenient to think of the fluid as 
flowing sideways, with the plates as longitudinal boundaries and the 
vicinity of the edges as the throat from which this fluid issues into the 
entire surrounding space. According to this point of view, the vertex A 
becomes the source and the vertex B becomes the sink. 

If the region enclosed by the polygon of Fig. 44 is now mapped upon 
the upper half of a z-plane in such a way that the origin and the point 
at Infinity for this plane are identified respectively with the vertexes 
A and B of the polygon, the equivalent flow map in the z-plane is simply 
given by the concentric circles about the origin (cquipotential loci) and 
the radial lines extending from the origin to infinity (flow lines). The 
vertex at the point C in Fig. 44 is then represented by a finite point on the 
real axis of the z-plane. 

In view of the fact that the points on the real axis of the z-plane cor¬ 
responding to the vertexes of the polygon must be arranged in such an 
order that they are encountered in the same sequence during a traversal 
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of the real axis in the positive direction (leaving the upper half plane to 
the left) as arc the vertexes of the polygon when its boundary is traversed 
in the corresponding positive direction (leaving the enclosed region to 
the left), it follows that the point on the real axis of the s-plane cor¬ 
responding to the vertex (' must lie to the left of the origin as indicated 

in Fig. 45. This is the point designated as 
s = Sj. Since this vertex is like the one 
shown in part (c) of f'ig. 40, the corres¬ 
ponding exponent n\ has the value —1. 

The vertex A, which corresponds to 2 = 0, 
is like the t)ne shown in Fig. 41. The 

/j-value for this vertex, therefore, is +1. 

As pointed out in the preceding discus¬ 
sion, a vertex which corresponds to the 
point = 00 is not represented by a factor of the form (f - 
in the integral 547 but comes about by virtue of the behavior of this 
function in the vicinity of the point at infinity. In other words, the cor¬ 
responding factor is implicitly rather than explicitly contained in the 
general form of the integral, which for the present problem is now recog¬ 
nized to read 





f'lG. 45. Contour in the z-plane 
for the problem of Fig. 44, 





dj _ 


+ N 


[581] 


Thus for the vertex B (corresix)nding to 2 = 00 ) one has, according to 
Eq. 574, 

= (2 + 1 - l)7r = 2ir [582] 


which checks with the above statement that this vertex has the character 
of uv in Fig. 43 for n, = 2. 

Equation 581 may more appropriately be written in the form 


w 


= M r 

%Jzq 


(i — Si) df 


+ A' 


[583] 


It is now convenient to choose the lower limit Zo equal to Zi, corresponding 
to the vertex C in Fig. 44. Here w must have the value yd, and since the 
integral in Eq. 583 vanishes for z = zo == Zi, it follows that 

N = jd [584] 

The constant M may be evaluated through calculating the increment 
in the function w corresp)onding to the increment in z resulting from a 
traversal of the semicircular detour about the point 2 = 0. For this 
semicircular path one may write 

f = pe’* 


[585] 
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in which p is the radius of the small arc. For small values of f, the factor 
(f ~ 2i) in the integral of Eq. 583 may be replaced by —Z\, and inasmuch 
as Eq. 585 yields 

^^jd<t> [586] 

it is seen that the increment in the function w corresponding to the arc 
increment in z becomes 


d<t> = jirZxM 


This increment in w must equal the change in the value of w which cor¬ 
responds to passing around the vertex A. With reference to Fig. 44 one 
sees that this change equals the increment in w between the bottom face 
of the condenser plate and the center line, and hence that this increment 
in w must equal --jd. Thus 

= —jd = jTTZiM [588] 


whence 


M = - 


The representation for the function w now reads 

d - zi)dt . 

^ --f- 

TTZi Jzx f 

The integration, which is straightforward, yields 


_ d~^ z 

T L 2i 


+ In s — In Si + jd 


Since there are no further conditions to be satisfied, it appears that the 
location of the point Si on the negative real axis in Fig. 45 may be chosen 
arbitrarily. A choice which yields a simple form for the resulting mapping 
function is Si = —1. Since In ( — 1) = 7 V, Eq. 591 becomes 

2 ^; = - [1 + z + In s] [592] 

TT 


This is the desired mapping function which converts the family of 
concentric circles about the origin of the s-plane and the orthogonal 
family of straight lines radiating from the origin (both confined to the 
upper half plane) into the orthogonal families of loci which map the field 
and the equipotential lines for the condenser plate in Fig. 44. If desired, 
this map may be converted to the rectangular reference form shown in the 
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/-plane of Fig. 46 through making the further change of variable given 
by Eq. 544. Then Eq. 592 becomes 


w 


= -[1 -h / + e‘l 


[593] 


The reference field in the /-plane, with several points of particular 
interest marked on it, is shown in Fig. 46. The edge C of the condenser 
plate in Fig. 44 where w = jd corresponds to / = yV. The under side of 
the condenser plate in Fig. 44 corresponds to the portion of the horizontal 
line n — Jk to the left of C; the 


top side of the plate corresponds 
to the portion of this line to the 
right of C. The center line in Fig. 
44 is given by the real axis of the 
/-plane. The transformation 593 is 
seen virtually to remove the 360- 
degree bend in the boundary at 
the edge C in Fig. 44 so that the 
top side of the condenser plate 
appears as a linear extension of the 
terest to note that the origin of Fq 



Fig. 46. The field of the parallel-plate 
condenser in the /-plane. 


bottom side. It may also be of in- 
;. 44 does not appear directly below 


the point C in the /-plane but is shifted to the negative real point 



Fio. 47. Relevant to plotting the Fig. 48. The contour in the 

flow in a right-angle bend. *-plane for the problem of 

Fig. 47. 


/ = —1.279. The process of transferring the rectangular grid of lines in 
the /-plane of Fig. 46 to the region of interest in Fig. 44 by means of the 
function 593 is left as an exercise for the reader. 

As a second example let it be required to determine the field map for 
the flow around the right-angle bend indicated by the shaded region in the 
U'-plane of Fig. 47. The polygon in this example has four vertexes. One 
lies at the origin O, another at the finite point P, and the remaining two 
at infinity. Both these have the character of the vertex u>, of Fie. 42. 
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They are here denoted as the vertexes A and B. They become the source 
and sink respectively for the present problem. 

The points on the real axis of the s-plane which are chosen to cor¬ 
respond to these vertexes are indicated in Fig. 48. The source vertex A 
is assumed to lie at the origin and the sink vertex B at infinity. The 
proper order, as determined from the corresponding directions of traversal, 
requires that the vertexes O and P lie respectively to the left and to the 
right of the origin. I hese are designated as the points 2 = 2 i and 2 = 22 . 

Recognizing that the exponents for the vertexes O, ^4, P are respec¬ 
tively +^, +1, and and choosing the lower limit 2o of the integral 
547 equal to 21 , one has 

+ N [594] 


or 


w 


=M r 

t/z, 


(r 




\l/2 ^ 




)■ 


[595] 


Since the origin of the 7£^-plane corresponds to the point 2 = 2 i, one has 
w{zi) == 0, and hence Eq. 595 yields 

.V = 0 [596] 

The reason for choosing the lower limit of the integral as the point 2 = 2 i 
is thus evident. 

In order to study the function in the vicinity of the vertex B which 
occurs for 2 •= oc, it is necessary to make the change of variable 

^ [597] 

whence 



The vicinity f = 00 is identified with the vicinity = 0, The increment 
in the function w resulting from passing around the vertex B at f* = 0 
is determined through considering the integral 595 for f 00 and making 
the substitutions 597 and 598. This gives 


Aw = —M 



[599] 


in which the integration is to be extended over a small semicircular arc 
of radius p about the origin of the f*-plane. For this arc 

r = 


[600] 
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and 

dr* 

[601] 

so that the integral 599 becomes 

= — yM d<t) = jtM [602] 

But ‘‘ passing around ” the vertex B in the U'-plane amounts to going 
from the right- to the left-hand boundary of the cross-hatched region B 
in Fig. 47 and hence yields an increment in the function w equal to —di. 
Therefore 

Aw = — di = jttM [603] 

In a similar manner, passing around the vertex A corresponding to 
the vicinity of f == 0 yields 



But according to P'ig, 47 this must equal jd 2 . Hence 
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If in the second integral one makes the change of variable indicated by 
Eq. 597 and also the consistent changes 


^ * -“1 

> S^l.2 = - 

Z 


[610] 


with the help of Eq. 606, one finds 
w 


r-_ _ [6nl 

TT Jzi V(f - Si)(r - Z2) ^ V iS;-* - 2*1) (f* - 2*2) 


The integration yields 

\z ^i^i ”b ^ 2 ) "b S'' (z Zi )(z 22 ) 


w = — In 


rjiZi - Z2) 


d-In 

TT 


S* - 1(2*, + 2 * 2 ) + \/(Z* - 2*,) (2* - 2 * 2 “)! 


1(2*1 - 2*2) 


I 

1 


[612] 


Inasmuch as an arbitrary specification with regard to Zi or Z 2 still 
remains open, it is possible, in agreement with Eq. 606, to set 


22 = T == 

do 


(I 2 

d\ 


Then Eq. 612 takes the form 


W = di +“/(2) + —f{i 


in which 


f (z) = In \ 


Idid-y 


+vG “ I) 


+ do^ 

2d\d2 


[613] 

[614] 

[615] 


For puri)Oses of calculation it may be helpful to note that the sub¬ 
stitution 


2 ”|- 




Ud, _ dA 
2\d^ d2/ 

2\d, dj 

converts the expression 615 to the form 

/(z') = In (z' + V\z^f - 1) 

If di — d 2 , the resulting mapping function is greatly simplified inasmuch 
as Eq. 616 shows that then z' = z. 


[616] 


[617] 
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As in the previous example, the field map may be reduced to a rec¬ 
tangular grid by means of the additional substitution z = 

26. Hurwitz polynomials; stability criteria 

In problems dealing with the dynamics of a physical system one is 
frequently concerned with the question of the stability of its behavior. 
In terms of the so-called characteristic equation of the system, which 
has the form 

+ * * * + CLlZ + == 0 [618] 

with real coefficients ao • ■ this question is answered in the affirmative 
if it can be established that all the real roots and all the real parts of the 
complex roots are negative. Stated in another way, the stability of the 
physical system is assured if it can be shown that all the zeros of the 
polynomial 

P{z) = + • • • + ais + ao [619] 

lie in the left half of the z-plane. A polynomial having this property is 
called a Hurwitz polynomial. 

The necessary and sufficient conditions which the coefficients of an 
arbitrary polynomial (with real coefficients) must satisfy in order that 
it be a Hurwitz polynomial are spoken of as the Hurwitz criteria. In 
dynamics these same conditions are alternatively referred to as Routh^s 
stability criteria. 

Starting with the factored form of the polynomial 619, which reads 

P{z) = a „(2 - 2 i)(z - 22 ) ■ • • (2 - 2 „) [620] 

one may readily establish (by multiplying out and collecting terms with 
like powers of z) that 

= —(Zi+Z2 + --- + Zn) 

On 

= ZlZ 2 + Z 1 Z 3 + • • • + Zn— lZ„ [621] 

an 


— = ( — 1 )** • Z1Z2 - Zn 

an 

If it is assiuned that all the roots are real and negative, and that an > 0, 
it is evident that all the coefficients are positive. If some or all of the roots 
are in the form of conjugate complex pairs, then one may likewise estab¬ 
lish (by the use of Eqs. 621) that all the coefficients are positive if the 
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roots have negative real parts. It is thus seen that the positiveness of the 
coefficients* is a necessary condition for the negativencss of the real parts 
of the roots of a given algebraic equation, but this condition alone proves 
to be insufficient, as is shown by the following discussion. 

One begins by investigating the significant properties of Hurwitz 
polynomials. In these considerations two simple facts form the basis 
from which the pertinent conclusions are readily obtained. These facts 
are, first, that the zeros of the polynomial P(z) lie in the left half of the 
2 -plane and, second, that their distribution in this half plane is sym¬ 
metrical about the real axis. The last statement is evident from the fact 
that complex roots must occur in conjugate pairs. 




(a) (b) 

Fig. 49. Relevant to the properties of a third degree Hurwitz polynomial. 

The polynomial is considered to be in its factored form as given by 
Eq. 620. For an arbitrary value of the complex variable z, the several 
factors for a polynomial of the third degree may be represented graphically 
as shown in Fig. 49. Parts (a) and (b) of this figure show how the graphi¬ 
cal representation of the factors changes when the algebraic sign of the 
variable z is reversed. It is clear that if z is chosen to lie in the left half 
plane (as in part (a) of Fig. 49) —z lies in the right half plane, and vice 
versa. It may also be seen that if z is replaced by its conjugate value z, 
the factors collectively represent the same set of magnitudes since pairs 
of factors representing conjugate roots merely become interchanged. 
This is, of course, also obvious from the fact that P(z) is the conjugate 
of P( 2 ), and hence these two values of the polynomial have the same 
magnitude. On the other hand, if the point z is replaced by its image 
about the imaginary axis (this amounts to replacing z by its negative 
conjugate value), collectively the magnitudes of the factors change in the 
same way as they do when z is replaced by —z. Points which are images 

*It is obvious that one may alternatively state that all the coefficients must be negative, 
the significant point being that they all have the same algebraic sign. 
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with respect to the imaginary axis are regarded as corresponding points 
in the left and right half planes. 

It should be clear from the representations in Fig. 49 that for any point 
z in the right half plane, the magnitude of the polynomial is larger than 
it is for the corresponding point in the left half plane. Together with the 
considerations of the preceding paragraph, this fact enables one to see 
without difficulty the truth of the following statements: 

|P( 2 )| > |P(- 2 )| for /?e( 2)>0 

\P{z)\ = \P{-z)\ ioxReiz) = 0 [622] 

|P( 2 )| < \P{—z)\ ior Re{z) <0 

in which Re denotes “ real part of.” Letting 

♦ (.) - ^ [623] 

one may alternatively express these results by 

\<t>(z)\ > 1 lor Re{z) > 0 

10 ( 2 ) I = 1 for Re (z) = 0 [624] 

\<t>iz)\ < 1 lor Re{z) < 0 


It should be clearly recognized that these statements hold only if 
F(z) is a Hurwitz polynomial, for if P{z) has any zeros in the right half 
plane, points can certainly be found for wdiich these statements collec¬ 
tively are no longer true. One may, therefore, conclude that if the condi¬ 
tions 622 or 624 are true, P(z) must be a Hurwitz polynomial. The rela¬ 
tions 622 or 624 are the necessary and sufficient conditions that a given 
polynomial P{z) have zeros in the left half plane only. By means of the 
succeeding manipulations, these conditions are put into a more usable 
form. 

The first step in this direction is to introduce the function 


^ ^ ^ P{z) + P{-z) 

0 ( 2 ) - 1 P(2) - P(-2) 


[625] 


According to the discussion given in Art. 24, this transformation maps 
the interior of the unit circle in the 0 -plane upon the left half of the 
0 -plane. Hence one has 

Re{\l/) > 0 for | 0 ( 2 )| > 1 

Re{\l/) = 0 for [ 0 ( 2 )| = 1 

i?e( 0 ) < 0 for 10 ( 2 )I < 1 


[626] 
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and, with the use of the relations 624, one obtains 
Re{4/) > 0 for Re{z) > 0 
Reiiff) = 0 for Re(z) = 0 [627] 

Re {if') < 0 for Re(z) < 0 

If the polynomial P(z) is written in the form 

P(z) = m(z) + n{z) [628] 

in which m{z) represents the terms involving even powers of z (called 
the even part of P) and n{z) represents the terms involving odd powers 
of z (called the odd part of P), according to Eq. 625, one has 

^ 

It is thus established that if m{z) and n{z) are the even and odd parts 
respectively of a Hurwitz polynomial, the rational function 629 has the 
properties expressed by the conditions 627, and, conversely, if the ratio 
of the even and odd parts of a given polynomial yields a rational function 
having the properties 627, that polynomial must be a Hurwitz polynomial. 

These properties are now examined in greater detail. Suppose the 
rational function ^(s) has a pole of the order s at some point z = Zv, 
The Laurent series for in this vicinity then reads 


^^'( 2 ) = ^ + • * ' + ^ y + ^0 + ^1 (2 “ 2.) + • • • [630] 

For points very close to z, one may write 


- ..)• 

[631] 

Letting 


5_, = ke’^ 

[632] 

and 


(z - z.) = 

[633] 

one has 


p 

[634] 

whence 


k 

Re{i/) ^ — cos (sa — $) 

P 

[635] 

It is thus seen that, in the immediate vicinity of 

the pole, the real part 
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of yp{z) assumes large negative as well as large positive values. More 
specifically, as a is allowed to vary from 0 to lir (the vicinity of the pole 
is explored through passing around it on a concentric circle of small 
r-adius), the real part of ^(s) is observed to change sign 2^ times. 

With reference to the conditions 627, one is forced to conclude im¬ 
mediately that the function ^(z) cannot have poles in either the right or 
the left half plane. This fact restricts the poles of ^(z) to lie along the 
imaginary axis of the z-plane. But the conditions 627 together with the 
Eq. 635 impose further restrictions upon these poles. The only conditions 
under which Eq. 635 for a pole on the imaginary axis does not conflict 
with the restrictions 627 are that = 0 and s = 1, for then Eq. 635 reads 


Re{yp) ^ 


k 

-cos a 

P 


[636] 


According to Eq. 633, Re{z) > 0 corresponds to — 7r/2 < a < 7r/2, and 
Re{z) < 0 corresf)onds to ir/l < a < 37r/2, whereas for Re{z) = 0, 
a = :Yiir/2, Equation 636 is thus seen to yield a real part of ^(z), which 
behaves in agreement with the conditions 627. The restriction that 
5=1 means that the pole must be simple, and = 0 requires that the 
residue of ^(z) in this pole be real and positive. 

The conditions 627, therefore, require that the rational function ^(z) 
have poles on the imaginary axis only and that these poles be simple and 
have positive real residues. In order to see that these requirements on the 
function ^(z) are also sufficient to assure the fulfillment of the conditions 
627, one need merely regard a typical term in the partial fraction expan¬ 
sion of f (s). Such a term reads 

kv 

(z Zp) 



Since the residue kp is real and positive, and Zp is a pure imaginary quan¬ 
tity, it is evident that the term 637 has the properties demanded by the 
conditions 627, and hence the finite sum of such terms which represents 
^(z) has these properties. 

One has thus gained a new formulation for the necessary and sufficient 
conditions that P{z) be a Hurwitz polynomial. Namely, the quotient of 
its even and odd parts must be a function having simple poles on the 
imaginary axis only, and with positive real residues in these poles. 

It is collaterally useful to digress for a moment and study somewhat 
more carefully the properties of the function ^(z). First it should be 
observed that if ^(z) satisfies the conditions 627, its reciprocal l/^(z) 
does so also. Hence, using Eq. 629, the function 

1 __ n{z) 

i/[z) m{z) 


[638] 
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must also have simple poles on the imaginary axis only and positive 
real residues. Both the even and odd parts m{z) and n{z) must, therefore, 
be polynomials whose zeros are simple and lie on the imaginary axis. 
Furthermore, since poles of ^(z) or l/^(z) which may lie at z = 0 or at 
z = 00 must also be simple, it follows that the highest powers of m(z) 
and «(z) as well as their lowest powers may not differ by more than 
unity. They obviously must differ at least by unity because m{z) and 
w(z) are respectively even and odd. 

If one writes 


^(a) = u{x,y) +jv{x,y) 

[639] 

the conditions 627 are seen to yield 


du „ 

— > 0 for * = 0 
dx 

[640] 

The Cauchy-Riemann Eq. 12 then shows that 


•^ > 0 for a; = 0 
dy 

[641] 


But by Eqs. 627, w = 0 for ic = 0, so that this result may alternatively 
be written 


— >0 for = 0 [642] 

jdy ^ ^ 


which states that along the imaginary axis (where ^ has pure imaginary 
values only) ^ is a continuously increasing function. The interesting 
consequence of this fact is that the zeros and poles of ^(z), which lie 
along the imaginary axis, must alternate. 

If the polynomials m(z) and n{z) are written in their factored forms, 
the expression 629 for ^(z) reads 


1A(2) = 


Cniz^ - 2l^)(s^ - Zz^) • • • (2^ - Z^2n-l) 
a,^_l2(2^ - 22^) (2^ - 24^) ■ ■ ■ - 2^2n-2) 


[643] 


in which it is arbitrarily assumed that the polynomial P{z) is of the 
even degree 2 n. The alternation of zeros and poles along the imaginary 
axis is expressed by the conditions 

0 < |2il < I 22 I < • • • < |22n-2[ < l22»-ll < « [644] 

This result is referred to as the separation property of the zeros and 
poles of Piz). 

Using Eq. 220 for the evaluation of the residues of \p{z) in any one of 
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its poles at 2 ~ 22 , 24 , • • • 22 n~ 2 , one has 

“ [(2 

^ ~ - 23 ^) * - • (g.^ - 2^n-l) _ . . 

an-.l22,2(s,^-~22^) • • • {Z,^-Z\^2){zj^-Z\^2) * * * {Zu^-z\n-2) 


On the assumption that dnAn-i is positive, it may be seen from this 
result that the separation property expressed by the inequalities 644 
assures the positiveness of the residues of ^( 2 ) in all its poles at finite 
frequencies. The residue of ^(s) at 2 = 00 , incidentally, is recognized to 
be ajan-u whereas the one at 2 = 0 has the value of 2 ^( 2 ) for 2 = 0 , 
which is positive since all the quantities are positive. 

In view of these further detailed results it may be stated that if P(z) 
is a polynomial with positive coefficients, and if its even and odd parts 
m{z) and n{z) differ in their highest and in their lowest powers by no 
more than unity and have simple zeros restricted to the imaginary axis 
where they mutually separate each other, P{z) is a Hurwitz polynomial. 

The purpose in thus stating in a variety of forms, the necessary and 
sufficient conditions that P(z) be a Hurwitz ix)lynomial is to focus atten¬ 
tion upon properties of these polynomials which frequently become 
collaterally useful. The actual process of making such a test may be 
based directly upon any one of the sets of conditions already stated. 
A particularly effective procedure, however, is derived from these con¬ 
siderations in the following manner. 

For any given polynomial, the function ^( 2 ) is readily formed accord¬ 
ing to Eq. 629. If P{z) is of an even degree, ^( 2 ) has a pole at infinity; 
otherwise 1 /^( 2 ) has a pole at infinity. Whichever may be the case, one 
begins the procedure by considering that function or \/i/) which does 
have a pole at infinity. Without any loss to the ensuing argument, this 
function is assumed to be ^( 2 ). More completely represented, it has 
the form 

+ an—32”"“^ -|- . . . aiZ 



The first step in the procedure is to divide the denominator polynomial 
into the numerator polynomial by the common process of long division, 
however, ceasing after only a single term in the quotient is determined. 
This yields 


= 


On ^ 2^” ^ o' ~ ‘ ~l~ o '+ o'0 

On-I + a„_3s'‘~^ + • • ■ + ai2 


[647] 


which may be indicated more compactly as 

On—I W(i>) 


[648] 
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If Piz), from which is derived, is a Hurwitz polynomial, must 
have simple poles on the imaginary axis with positive residues. In partic¬ 
ular the pole at infinity, represented by the first term in Eq. 648, must 
yield a positive residue. Hence one has the first particular condition 


> 0 [649] 

If i/{z) is imagined to be represented by its partial fraction expansion, 
one may identity the first term in Eq. 648 with that term in this expan¬ 
sion which represents the pole at infinity. The remaining terms in this 
partial fraction expansion are then seen to represent the corresponding 
expansion for the function given by the second term in Eq. 648. This 
function is the remainder after the pole at infinity is removed from ^Hz). 
It thus becomes clear that this remainder function must have the same 
properties as i^(z), namely, simple poles restricted to the imaginary axis 
and positive real residues, and its reciprocal must likewise have these 
properties. 

Denoting the reciprocal of the remainder function by i>*{z), one has, 
according to Eqs. 647 and 648, 

J*( \ _ qn-l2”~^ + gn-3S"~^ H- aiZ 

O' n~22 O' 71—4^ H- • • * i- a 2S “T 0 



This function evidently again has a simple pole at infinity. Repeating the 
process of long division as before, one obtains 

if., X _ On^\ J_ + * * * + o'lZ 

2 “ t " -j- . . . -j- + o'q 



or more compactly 




«n-l _ . n (z) 

- Z -j- 

a n-2 rn (z) 


[652] 


The positiveness of the residue of ^*(z) in its pole at infinity requires 
the second particular condition 


^ > 0 [653] 

O n—2 

The second term in Eq. 652 is a subsequent remainder function which 
again must have the same properties as y('(z), and its reciprocal must 
also have these properties. The inverted remainder function 

[654] 

again has a simple pole at infinity with a residue which must be positive. 
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The continuation of the process is thus clear, and leads successively to 
additional particular conditions like the ones expressed by the inequali¬ 
ties 649 and 653. The procedure terminates after all the terms in m{z) 
and n(z) are exhausted. 

Letting 

an 


0 L 2 


^n~l 

a \-^2 


^3 


a'n^2 

o'n-3 


[655] 


one obtains finally a representation for ^( 2 ) of the form 

Hz) = aiz + — , 1 

«22 H-, 

OC3Z + 



OCnZ 


[656] 


which is referred to as a finite Stieltjes continued fraction.* It contains 
altogether n terms, as is clear from the following series of fractions indi¬ 
cating merely the degrees of the numerator and denominator polynomials 
appearing in the original function 4 /{z) and in the successively en¬ 
countered inverted remainder functions ^*( 2 ), ^**( 2 ), etc. 


n w — 1 w — 2 

« — 1 n — 2 w — 3 


2 1 

\ 0 


[657] 


The necessary and sufficient conditions that P{z) be a Hunvitz poly¬ 
nomial are now simply expressed by the statement that all the quantities 
« 2 > <X 3 , etc., as given by Eqs. 655 must be positive. 

This procedure for testing a given polynomial may be replaced by a 
complementary one in which terms representing poles at z = 0 are 
removed from ^(z) and the successive inverted remainder functions. 
One may say that this variation in the method amounts merely to re¬ 
placing z by 1/z and proceeding as discussed above. The test is thus 
applied to the polynomial P(l/z) instead of to P{z). Since the transforma- 

*This is one having the form of Eq. 656 in which ail the coefficients are positivereal numbers. 
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tion s 1/5 maps the left half plane upon itself, it is clear that P{z) is 
proved to be a Hurwitz polynomial if it can be shown that P{l/z) is such a 
one. 

To carry out this variation in the procedure one begins again with the 
expression 646 for but with the polynomials turned end-for-end. 
The first step in the process of dividing the denominator into the numer¬ 
ator yields 

,, ^ ao , a'W H-1- a"nZ'' 

^(2) --1- -j-^-— 

CiZ diZ 4“ * • • “f" dfi^iz^ 

The first particular condition reads 

^ > 0 

dl 

The inverted remainder must again have the same properties as ^|/{z) 
because the second term in Eq. 658 is equal to the partial fraction ex¬ 
pansion of ypiz) minus the term for the pole at z = 0. This second term, 
therefore, has the stated properties and so does its reciprocal. The 
inverted remainder, moreover, again has a simple pole at z = 0, and the 
requirement that the residue in tliis pole be positive yields the second 
particular condition 

■%>0 [660] 
d 2 

and so forth. 

One thus arrives at the alternate finite Stieltjes continued fraction 

+ 



in which 


+ 



[ 661 ] 




£0 

dr 







2 

3 


[662] 
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The necessary and sufficient conditions that P{z) be a Hurwitz poly¬ 
nomial are that all the coefficients • • • / 8 n be positive. These conditions 
are entirely equivalent to the ones involving the coefficients ai • • * 
given by Eqs. 655, although they are different in their detailed appearance. 
It should be clear, however, that the quantities 01 • • • as functions of 
the coefficients ao, ai, • • • of the given polynomial P(s) must be the 
same as the expressions for «i • • • an in terms of these coefficients except 
that the consecutive order of the subscripts 0 , 1, 2 , • • • n on the a^s is 
inverted. In other words, if in the expressions for ai ••• an one makes the 
substitutions indicated by 


dn ^0 

fln —1 

. [663] 

dl —^ ^n -1 

fl O d n 

the corresponding ones for 0 i • • • 0 n are obtained. 

In order to determine the expressions for the a’s or 0 ’s in terms of the 
coefficients ao • • • an of the polynomial P{z) from the results expressed 
by Eqs, 655 and 662, it is necessary to carry through the indicated 
processes of long division involved in the steps leading to the continued 
fraction expansions 656 and 661, so as to obtain the coefficients 
a'o • • • a'n- 2 , d ^'2 • • • as functions of ao • • • an. If this is done 

for the 0 ^s, one finds that the results obtained for the first three steps 
(that is, for the determination of 0 i, 02 , 03 ) yield conditions which may be 
expressed in the form 

Di = ai ]> 0 

D 2 
Dz 


ai ao 
aa a 2 


> 0 


ai aQ 0 
as a2 ai 
as a4 Ua 


[664] 


> 0 


with the condition dp > 0 tacitly understood. From the structure of these 
determinants and the recurrent nature of the process of derivation, one 
may assume that the determinant of ;/th order has the form 




aj ao 0 • • • 0 

dg d2 di dg 0 • • • 0 

ds d4 d 3 d 2 di do 0 • • • 0 


[665] 


d2n—l d2n—2 


a, 
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The correctness of this generalization may be verified through showing 
that it is consistent with the process of deriving an n\h degree Hurwitz 
polynomial from one of the degree » — 1. Suppose the latter is written 
in the form 

Pn~i = + a2Z^^ +-h an^iZ + [666] 


in which the order of the coefficients is reversed, so that the expressions 
for 0 in the former polynomial become identical with those for a in the 
present one. The corresponding function reads 

+ • • * + an-^iz 



Since this function has a zero at infinity, the one associated with a 
Hurwitz polynomial of the wth degree may be formed by adding to the 
expression 667 a term representing a simple pole at infinity with a posi¬ 
tive residue. This function may, therefore, be written 




[ 668 ] 


with the condition that ao > 0. Using Eq. 667, one finds 

^n = 

- 

[669] 

and the associated polynomial reads 


Pn = aoaiz^ + aiz^ ^ + (aods + < 12 ) 2 ^“’^ + 

+ an—12 + an [670] 

From the manner of its derivation, Pn is a Hurwitz polynomial if 
is known to be such a one, and if ao is positive. The criteria which 
assure that Pn~i be a Hurwfitz polynomial may, according to Eqs. 665 
and 666, be expressed by writing 


(l2 

ai 

0 

0 

a4 

as 

a2 

Cl 

Uq 

as 

04 

03 

(^8 

07 

ae 

• 

06 


• 

• 

• 


[671] 


with the understanding that ai > 0 and that one is to consider all 
principal minors of this determinant which are formed by the first, the 
first two, the first three, etc., rows and colunms. 
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According to determinant theory it is readily recognized that 



ai 

0 

0 

0 

0 

03 

0,2 

Oi 

0 

0 

05 

04 

03 

O2 

Ol 

07 

06 

06 

O4 

03 

09 

ag 

^7 

06 

06 


[672] 


which is formed from the determinant 671 by the addition of a first row 
and column as indicated. Since ai > 0, the conditions formed from this 
modified determinant are identical with those formed from 671 except 
that one must begin with the consideration of two rows and columns in 
order to obtain successively the same conditions as before. 

The first, third, fifth, etc., columns in the determinant 672 are now 
multiplied by the positive constant ao, and the determinant is then 
modified in form (although not in value) by adding to the elements of the 
second column the corresponding ones of the first column, and to the 
elements of the fourth column the corresponding ones of the third column, 
and so forth. This yields 


OqCLi Co^tl 0 0 

(flo®3 + ^2) O0®l 

(<*0^5 + 04) ®0®3 (®0®3 + O2) 

ao®7 (flo®7 d" Oo®5 (oo®6 d~ <* 4 ) 


[673] 


If the constant Oq is now imagined to be factored out of the first, third, 
etc., columns, one observes that the result is a determinant D„ from which 
the criteria for the polynomial 670 are formed in the same manner that 
the criteria for the polynomial 666 are formed from the determinant 671. 
Thus, by the method of induction, the correctness of the relations 664 
and 665 for the desired criteria (these are the Hurwitz criteria) is es¬ 
tablished. 

Routh, who first derived these criteria* (although he stated them in a 
somewhat modified form) made use of a theorem of Cauchy’s, which, for 
the sake of its collateral interest, is briefly discussed in the following 
paragraphs. 

A finite polynomial is written in the form 

P(z) = u(x,y) +jv(x,y) 

* Adams Prize Essay ^ 1877; Rigid Dynamics, paragraph 290. 


[ 674 ] 
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and the behavior of the quotient 




u{x,y) 

v{,x,y) 


[675] 


is observed as the point z — x + jy traverses once around a simple closed 
contour C which does not pass through a zero of P{z). As is shown in 
detail presently, the function q{x,y) is seen to change its algebraic sign 
either by passing continuously through zero or by passing through the 
value 00 . Considering only the continuous passages through zero, one 
observes the number of changes of sign from plus to minus and the 
number of changes from minus to plus. Denoting these numbers by r and 
s resp>ectively, the theorem of Cauchy states that — 5 ) is the number 
of zeros of P{z) enclosed by C. 

To prove this theorem it is expedient to write the polynomial in the 
factored form 


P(z) — A (z 2 i)(z 22 ) • • • (2 2n) 

[676] 

in which .4 is a real constant and is assumed to be positive. Each factor 
may be represented in the polar form 

(2 - 2 .) = 

w'hence 

[677] 

P(z) = ^ • fi • fa ■ • • r„ • — 

Letting 

[678] 

A ft fz- -rn = P 

and 

[679] 

+ ^2 + • • • + 

one has 

[680] 

P(z) = — R cos B + jR sin B 

Reference to Eqs. 674 and 675 then shows that 

[681] 

9 (^>3') = cot B 

[682] 


It remains to see how the angle B behaves as the variable z — x jy 
traverses once around a simple closed contour. For a single factor, as 
given by Eq. 677, this behavior is illustrated in Fig. 50. In part (a) of this 
figure the point z = z^ is assumed to lie outside the closed contour C, 
whereas in part (b) of the figure the point 2 == lies within the contour. 
It is immediately apparent that the ne/ change in By as z traverses the con¬ 
tour is either zero or 2t according to whether Zy lies outside or inside the 
contour. The net change in the resultant angle as given by Eq. 680, is 
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thus seen to be ItN, with N equal to the number of zeros of P{z) enclosed 
by the contour C. Reference to the expression 682 for the quotient q = 
m/d now reveals the truth of the theorem without further difficulty. 

It may be of interest to point out that the behavior of the angle 6 can 
be determined alternatively from the theorem given in Art. 19 involving 



Fig. so. The net change of 6, is 0 for (a) but is 27 r for (b) 


the number of zeros and fxiles of a function within a giv^en region. Let the 
function be/( 2 ), and write it in the polar form 

fiz) = [683] 


Then 


6 = Im (In /) 


[684] 


in which Im denotes “ imaginary part of.” Now 

dB = Im ^ 


and hence Eq. 282 yields 



[685] 


[ 686 ] 


Thus the net change in angle AO is found to be equal to 2 t times the dif¬ 
ference between the number of zeros and the number of poles of /(z) 
enclosed by the contour C. The polynomial P{z), given by Eqs. 674 or 
676, can have no poles in the finite 2 -plane, and hence the present result 
agrees with the conclusion reached above. 


27 . Positive real functions 

A rational function w = f{z) which is real for real values of z, and whose 
real part is positive for all values of z with a positive real part, is called a 
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positive real function* (abbreviated p.r. function). These conditions are 
written 


/(s) real for s real 
/?c[/(2)] ^ 0 for Re{z) § 0 


[687] 


Functions of this sort play an important part in electrical network theory, 
and it is therefore of interest to study their })roj)erties in some detail. 

Since the function very often is an impedance, it is customarily denoted 
by the letter Z./Fhe independent variable is the complex frequency, 
which is written X = cr Being a rational function, Z(X) is given 

by the Cjuotient of two polynomials, and since Z(X) is real for real values 
of X, these polynomials must have real coefficients. One may write 


Z(X) = 


P(X) 

C(x) 


U 1 )_+ /!’! (O' 

M2(o,a)) + ./?2(o,w) 


[ 688 ] 


in which ui and M2 arc the real parts of the polynomials P and Q respec¬ 
tively, and I'l, V2 are the corresponding imaginary parts. Rationalizing, 
one finds 


and similarly 


AV[Z(X)] - 


Rc 


[5,] 


'li\U2, “h 

[689] 

U2'' “b 

-1- T'i7'> 

Mi“ -4- 1^1- 

[690] 


Since the denominators in the last two expressions must always be posi¬ 
tive, it is evident that if Z(X) is [X)sitive real, Its reciprocal is also posi¬ 
tive real. 

The poles of Z(X) are the zeros of Q{\)> In the vicinity of one of these, 
one may represent Z(X) by the Laurent series 

+ ■ ■ ■ + x:) + (X - XJ + ■ • • [691] 

For points very dose to the pole one may write 

Letting 

(X -- X,) = [693] 

*It is not necessary that the function be rational, although in most practical problems to 
which the present discussions are relevant the pertinent functions are rational. 
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and 

one obtains for this vicinity 

k 

Re[Z{\)] ^ — cos {s<t> — jS) 


[694] 

[695] 


As the immediate neighborhood of the pole is explored through allowing 
0 to vary from zero to 2ir, one observes that the real part of Z(\) changes 
sign 2s times. It is clear, therefore, that Z(X) can have no poles in the 
right half of the X-plane. It follows furthermore that poles may lie on 
the imaginary axis but that such poles must be simple (5=1) and the 
function Z(X) must there have jx^sitive real residues (/3 = 0) so that, 
for the immediate vicinity of such a pole, Eq. 695 becomes 

k 

Re[Z{\)] ^ - cos 0 [696] 


which remains positive for -~7r/2 < <^ < 7r/2, that is, for values of X in 
the right half plane. 

Since the same conclusions apply also to the reciprocal function 1/Z(X), 
one recognizes that the zeros of the polynomials P{\) and Q(\) must 
have real parts which are not positive. That is, P(X) and Q(X) must be 
Hurwitz polynomials.^ 

More explicitly, the expression for Z(X) may be written 


^ “ (KX) ~ bo + bi\ + b2\^ + • • • + 


[697] 


If the degree « of P(X) is higher than the degree ni of ()(X), then Z(X) 
has a pole at X = oo. Since this point may be regarded as lying on the 
imaginary axis, such a pole, if present, must be simple. Similarly, if 
ap 9 ^ 0, the function Z(X) has a simple pole at X = 0 if ftp = 0; it has 
a pole of second order at X = 0 if 6p = =0, and so forth. Since the 

point X = 0 lies on the imaginary axis, a {X)le there must also be simple. 
Recognizing that the same conclusions apply to the reciprocal of Z(X), 
one sees that the positive real character of Z(X) imix)ses the further 
restriction that the lowest as well as the highest powers of the polynomials 
P(X) and Q(X) can differ at most by unity. 

In examining a given function Z(X) for the purpose of determining 
whether or not it is positive real, it is not sufficient to establish that 
P(X) and (?(X) are Hurwitz px>lynomiaIs and that their lowest as well 
as their highest powers differ by no more than unity. To form the expres- 

*The term Hurwitz polynomial as used in the present article includes polynomials having 
zeros on the imaginary axis. 
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sion 689 for the real part of Z(X) and examine its behavior over the 
entire right half of the X-plane, however, is a laborious procedure which 
one would like to avoid. In this regard it is found helpful to make use 
of the theorem (discussed in Art. 21) which .states that if a function is 
analytic within and on the boundary of a given region, the maximum 
and minimum values which the real and imaginary parts of that function 
assume on the boundary are maxima and minima for the enclosed region. 
This region, in the present problem, is taken to be the right half of the 
X-pkne; its boundary is the imaginary axis. 

If Z(X) is a ix)sitive real function, it is analytic in the right half plane, 
and if, for the moment, one assumes that Z(X) has no poles on the imagi¬ 
nary axis, the theorem just cited assures that the smallest value which 
the real part of Z(X) assumes on the imaginary axis must be smaller 
than any value which this real part may have over the entire right half 
plane. Conversely, if Z(X) is analytic in the right half plane and on the 
imaginary axis, and if the real part of Z(X) on the imaginary axis is 
now^here negative, this real part must remain positive over the entire 
right half plane, and Z(X) must be a positive real function. 

The stipulation that Z(X) be analytic on the imaginary axis may be 
dispensed with, for if Z(X) has poles on the imaginary axis, it is merely 
necessary to modify this boundary by inserting vanishingly small semi¬ 
circular detours at such poles, so that the resulting boundary avoids 
these points by passing slightly to the right of them. As shown above, 
the requirement that the real part of Z(X) shall remain positive on a 
small semicircular detour is taken care of by the stipulation that poles 
on the imaginary axis be simple and that the residues of Z(X) at such 
poles may be real and positive. 

The necessary and sufficient conditions that a rational function Z(X), 
which is real for real values of X, be positive real may thus be stated in 
a form which does not require an investigation of the real part of Z(X) 
over the entire right half plane. Such a statement reads: 

//Z(X) is analytic in the right half plane^ and 

if on the imaginary axis this function has only 

simple poles with positive real residues, Z(X) [698] 

is a positive real function if Re[Z(ja;)] ^ 0 

for all real values of w. 

In order to form the real part of Z(X) for X = ^oj, one may begin with 
the expression 697 and in each of the two polynomials group the terms 
with even and odd powers respectively. That is, the polynomials are 
written 


P(X) = mi(\) + »i(X) 
C^(X) = W2(X) + W2(X) 


[ 699 ] 
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in which Wi and m 2 are the terms involving even powers of X, whereas 
»i and n 2 are the terms involving odd powers of X. It is clear that for 
X = j(j), m\ and m 2 are real, whereas Mi and «2 are imaginary. A process 
of rationalization applied to Z(X), therefore, yields 


Z(\) = + ”l)(”^2 - Hz) 

{ m2 .+ « 2)(»»2 — « 2 ) 


[700] 


from which it is clear that* 


/wimz - Mi«2\ 
22e[ZO«)] = ( —^^ ) 

\ m 2 — flz /\. 


[701] 


The denominator in this expression represents the square of an abso¬ 
lute value and hence is surely positive. The condition i?e;[Z(yw)] ^ 0 is 
thus seen to be expressed by 

(wim2 — M 1 W 2 ) = Oj for X = yo) [702] 


If P(X) and Q(X) are assumed to have the same degree n (this assump¬ 
tion does not restrict the generality of the present argument), it is clear 
that (miW 2 — ^ 1 ^ 2 ) is a polynomial of the degree n in the variable X^. 
One may, therefore, write 

(W 1 W 2 ~ «lW2) = ^I(Xi^ — — X^) • • • (Xn^ — X^) [70v^] 


or, for X = jcc, 

(W 1 W 2 ”” W 1 W 2 ) ~ 4“ 4" 4” [704] 

The constant A must evidently be positive if this expression is to be 
positive for all values of oj, since it must still be positive for w —^ 00 . The 
X^-roots, which are denoted by Xi^, X 2 ^, * • • Xn^, may be complex as 
well as real, but since the polynomial 703 has real coefficients, any 
complex roots, if present, must occur in conjugate pairs. Such a pair of 
roots leads to a pair of conjugate complex factors in the expression 704, 
and hence yields a resultant kctor which is the square of an absolute 
value. Complex as well as positive real X‘^'-roots, therefore, yield 
factors in the expression 704 wliich are surely positive for all real 
values of w. This statement is still true if some of the real X^-roots are 
zero. A negative real X^-root of even multiplicity leads to a factor in 
the expression 704 which is raised to an even power, and hence such a 
factor is also surely positive. However, if there exists a negative real X^- 
root of odd multiplicity (for example, a simple root of this sort), the ex¬ 
pression 704 is surely negative over some part of the range 0 < < 00 , 

*The functions w(X) and »(X) should not be confused with tt(<r,«) and r(<r,w) appearing 
in Eqs. 688, 689, and 690. m and n become identical with u and jv respectively for X = 
that is, only for <r = 0. 
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It thus becomes clear that the necessary and sufficient condition insuring 
Re[Z(ja;)] ^ 0 is simply that^ in addition to being positive for ~ oo, 
the polynomial (mim 2 — nin 2 ) shall have no negative real \^-roots of odd 
multiplicity. The fulfillment of this condition together with an assurance 
that Q{\) is a Hurwitz polynomial suffices to prove that Z(X) is a positive 
real function provided ()(X) has no zeros on the imaginary axis. If it has, 
one must also establish that these zeros are simple and that the residues 
of Z(X) there are real and positive. If Z{\) is found to be a positive real 
function, one may be sure that P(X) is, of course, also a Hurwitz poly¬ 
nomial. 

If ()(X) has zeros on the imaginary axis andP(X) does not, it is easier to 
establish the positive real character of the reciprocal function 1/Z(X) 
because the latter then has no poles on the imaginary axis although 
Z(X) does. When 1/Z(X) is found to be positive real, it follows without 
further proof that Z(X) is positive real also. 

A limiting form of the positive real function Z(X) results if its real 
part is identically zero for X = jo. According to Eq. 701 this situation 
requires the condition 

(W 1 W 2 — »iW2) = 0 [705] 

in which X need not be restricted to pure imaginary values.* If, for the- 
moment, none of the polynomials mi, m 2 , Wi, »2 are considered to be zero, 
one may write the condition 705 in the form 


m\m2 



[706] 


a representation for the polynomial n^ that is r)ossible only if mim 2 con¬ 
tains ^2 as a factor. Since m 2 4* ^2 is a Hurwitz polynomial, the parts 
m 2 and W 2 have no common factors (the discussion of the preceding 
article shows that the zeros of m^ and W 2 separate each other on the 
imaginary axis). Hence the identity 706 can be fulfilled only if 

^ and Wi = [707] 

the factor V* arising from the observation that one may multiply nu¬ 
merator and denominator on the right-hand side of the identity 706 by 
any power of X. The functions m and n being respectively even and odd, 
it is clear that the integer p is odd. 

The results 707 now yield for the impedance 

Z(X) - . X. 

m2 + W2 



*It should not be inferred from Eq. 701 that, if in\m 2 — nin^ vanishes for all values of X, 
so does the real part of Z(X), for the expression 701 represents the real part of Z(X) only for 
X = jw, not for X-values in the comple-x plane. 
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in which one can insert a constant multiplier if desired. Since a pole of 
Z(X) at infinity must be simple, one has p = The function Z(X) thus 
obtained is trivially simple. 

The only other conclusions permitted by the identity 70S, if Z(X) is 
not to become identically zero or identically infinite, read 

»ii E3 0 and M 2 = 0 

[709] 

or 


Ml s 0 and J «2 = 0 

[710] 

Correspondingly the inij>e(lance becomes 


^(X) = 

Vh{\) 

[711] 

or 


Z(X) = 

«ZX) 

[712] 


According to tlie discussion of Hurwitz polynomials given in the pre¬ 
ceding article it is seen that these functions Z(X) have simple zeros and 
p>oles restricted to the imaginary axis. Thus the special form of a positive 
real Z(X)-function whose real j)art is identically zero for X = 70 ? is the 
same as that sj)ecial function whose poles are restricted to the imaginary 
axis. One may say that if Z[\) is a ]H)sitivc real function whose real part 
is identically zero for X -- the zeros of hoi/i I^i\) and ()(X) must lie on 
the imaginary axis. 

Since Z(X) is by dc'hnition a [>ositive real function, the residues in all 
its poles are real and ])ositi.ve. A partial fraction exi)ansion of such a 
Z(X)-function reads 


Z(x) - •- + - + - --- 

^ ^ X x -x.> x-t X-, 


X — X 4 X -}- X 4 


■ + [ 713 ] 


The terms in this expression, exccj)! f(>r the first and last, are pairs of 
conjugates. Since the ]x>les art* restricted to the imaginary axis, the conju¬ 
gate of X,. is —X,,; and since tlie residues are real, conjugate poles (wliich 
normally involve conjugate* resitlue.s because Z(X) must be real for real 
X s) yield identical residues. Tlie first and last terms in Eq. 713 represent 
possible poles at X — 0 and X = 00 . 

Combining conjugate complex terms iu the expression 713 gives 


Z(\) 


ko 


+ 


2k.,\ 

- xZ 


+ 


X^ - X 4 ' 


+ • • • + k2p\ 


[714] 


Since 


Xy “■ £iiid Xjf^ — ““ (0|»— 


[715] 
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one finds 


\ ^0 , 2A'2ia> , 2A-4./W 

Z{j(j}) = - I- 2 ~2 -2 : 

J(jJ (jJj — 03 034—03 


+ • * • + k2pjo3 [ 716 ] 


This special form of the function Z(jo}) is of practical interest because it 
represents the impedance of a lossless network. The function Z{\) in this 
case is evidently on the borderline with respcc t to the property of being 
}X)sitive real. 

In terms of the factored forms of the jxdynomials P{\) and ()(X), this 
function Z{jo3) has a representation of the form 




H{o3 \ - 03‘^){03\ - C.-) • ■ • ~ 

jo3{03“2 ~ — W”) • • • 


[717] 


in which H is a positive real constant. 

Even in this special limiting case the real part of Z(X) is zero only on 
the imaginary axis of the X-plane. For complex X-\ alues one has 

Z(X) = R(a,o3) +jX{a,03) [718] 


in which R and X are the real and imaginary j)arts. According to the 
Cauchy-Riemann Eqs. 12 and 13, 


da do3 do3 da 


[ 719 ] 


Since 2 ?(<t,w) is identically zero for a == 0 and positive for a > 0, it 
follows that dR/da is f)ositive and hence that dX/do3 is fx)sitive for 
(7 = 0. In other words, when all the poles of Z(X) lie on the imaginary 
axis and its real part there is identically zero, one has 


d^\ 

/X - iw 


dZ (/ct)} 

— 7 -j ->0 for—oo<a;<oo 

J do3 


[720] 


A similar relation then also holds for the reciprocal function. 

This result states that the real function Z{jo3)/j of the real variable 
03 has a positive slope for all values of 03 , As a consequence it follows that 
the zeros and poles of Z(X), which are all simple and lie along the imagi¬ 
nary axis, must mutually separate each other. This alternation of zeros 
and poles may (with reference to the notation in Eq. 717) be expressed by 

0 < 0)1 < W2 < * ’ • < 032p-2 < [721] 


It is significant to observe that a positive real function in this limiting 
case has properties identical with those of the function ^(s) discussed in 
the previous article (see Eq. 625 and following). A function of this type 
is represented by the reactance or susceptance of a lossless electrical 
network. One may, therefore, state that the polynomials whose ratio 
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represents the reactance or the susceptance of a lossless network, are the 
even and odd parts of a Hurwitz polynomial. The converse of this state¬ 
ment is likewise true. When the expression 688 represents such a re¬ 
actance or susceptance function, one of the polynomials P(X) or Q(X) is an 
even and the other an odd function of X, as shown by Eqs. 711 and 712. 

Returning to the general case, one may discover additional useful 
properties of the positive real function by considering its linear fractional 
transformation 


1 - ^(X) ^ 0(X) - P(X) 

1 -f- Z(x) g(x) + P(x) 


[722] 


As shown in Art. 24, this transformation maps the right half of the 
Z-plane upon the interior of the unit circle in the z-plane (and vice 
versa), the imaginary axis of the Z-plane becoming identified with the 
unit circle in the z-plane. If Z(X) is a positive real function, points in the 
right half of the X-plane correspond to points in the right half of the 
Z-plane and hence to points within the unit circle of the z-plane. One 
may state 

//Z(X) is positive real, Iz(X)( g 1 for Re(X) ^ 0 [723] 

It is readily appreciated that the converse must be true also; that is, 
// |z(X)| g 1 for Re(X) ^ 0, then Z(X) is positive real [724] 

Moreover, if Z(X) is positive real, then z(X) must be analytic in the right 
half plane and on the imaginary axis, for 1 -f- Z(X) cannot be zero there. 
According to the principle of the maximum modulus (discussed in Art. 
21), the largest value which lz(X)| assumes on the imaginary axis of the 
X-plane must be a maximum for the entire right half of that plane. 

Conversely, one may state that if z(X) in Eq. 722 can be shown to be 
analytic in the right half plane inclusive of the imaginary axis, and if on 
this boundary |a(X)| g 1, this inequality must hold for the entire right 
half plane and, according to the statement 724, Z(X) must be positive real. 
It is now interesting to consider the function 

^ [725] 


in which 

P*(X) = Wi(X) + n 3 (X) 
Q*(X) = + »i(X) 


[726] 


Comparing these relations with Eqs. 699, one observes that the poly¬ 
nomials R*(X) and ^(X) are formed from P(X) and Q(X) by interchange 
of their odd parts. In terms of Z*(X) one now forms the expression 
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analogous to 722, namely, 


z*(X) = 


1 - Z*{\) 
1 + Z*(X) 


C>*(X) - P*(X) 
e*(X) + P*(X) 


According to Eqs. 699 and 726 it is readily seen that 
(2*(x) + P*(x) = ^(x) + P{\) 


[727] 

[728] 


Since it has iilready been shown that the polynomial P(X) + ^(X) has 
no zeros in the right half plane or on the imaginary axis when Z(\) is 
positive real, one observes in that event that s*(X) is analytic in the entire 
right half plane inclusive of the imaginary axis. 

From the mapping properties of the function 727 it follows that |z*(yw)| 
g 1 for ^ 0. The latter inequality is found, from Eqs. 725 

and 726, to be expressed by 


/ wiWa - «i«2 \ . ^ 

\ - ni^ A-,«“ 


[729] 


or, since — «i®) for X = ju is the square of an absolute value, one 
has more simply 

— «i« 2 ) ^ 0, for X — jw [730] 


This is the condition 702, which is fulfilled if Z(X) is positive real. In 
this event the present argiunent is thus seen to yield |z*(7« )| ^ 1, and 
since is analytic in the right half plane inclusive of the imaginary 
axis, the principle of the maximum modulus enables one to conclude that 
| 2 ’*'(X)| g 1 throughout the entire right half plane. According to the 
statement 724, therefore, the function Z*(X) is then seen to be positive 
real. This conclusion is summarized by the statement: 

If the rational function Z{\), given by the 
quotient of polynomials P(X) and Q(X), is 
positive real, the rational function which 
results after the even or odd parts of these ^ -* 

polynomials are interchanged is also posi¬ 
tive real. 


Since Z*(X) is positive real, it follows that P*(X) and Q*(X) are Hurwitz 
polynomials. Hence one may state 

If the quotient of polynomials P(X)/Q(X) 

is a positive real function, not only these 

polynomials but also those which result [732] 

from an interchange of their even or odd 

parts are Hurwitz polynomials. 
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Further practically useful results are obtained from an investigation 
of the properties of positive real functions in polar form. The first step 
in this direction is the introduction of the relations 


s(X) = 


X - ^ 
X ~i~ A 


or 


X 


= A ■ 


1 + z 
1 — z 


[733] 


and 


w(z) 


Z(X) - B 
Z(X) + 


[734] 


The positive real constants A and B have any values satisfying the 
relation 

Z{A) = B [735] 

By means of the transformation 733 the interior of the unit circle in 
the z-plane is mappod upon the right half of the X-p)lane. The positive 
real function Z(X) relates points in the right half X-plane to points in the 
right half Z-plane, and these in turn are mappod upon the interior of the 
unit circle in the w-plane by means of the transformation 734. As a 
consequence of the relation 735 between A and B, the origin in the z-plane 
corresponds to the origin in the w-plane, that is, 

Jt-fO) = 0 [736] 

The function Z and its independent variable X are now represented in 
the polar forms 

X = pe?* and Z = [737] 

In terms of the variables thus introduced, Fig. 51 illustrates the identical 
transformations 733 and 734. Part (a) shows how the concentric circles 
(p = constant) and the radial lines (0 = constant) of the right half 
X-plane appear inside the unit circle of the z-plane, and part (b) similarly 
illustrates the appoarance of the polar representation of Z within the unit 
circle of the zf-plane. In each case the unit circle itself repjresents the 
imaginary axis of the X- or Z-pIane, the left-hand point on the circle 
{z = w = — 1) corresponding to the origin in either of these planes and 
the right-hand one (z = w = 1) to the point at infinity. 

The imaginary axis of the X-p>lane thus corresponds to |s| = 1. There¬ 
fore, if Z(X) is a positive real function, points on the locus |z| = 1 yield 
Z-values which are in the right half or on the imaginary axis of the 
Z-plane and hence within or on the unit circle of the w»-plane. That is, 
one may state that 

l^i ^ 1 for \z\ = 1 [738] 

In view of this result and the condition w(0) = 0, as expressed by 
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Eq. 736, it is recognized that Schwarz’s lemma (see Art. 21) enables 
one to make a considerably stronger statement, namely, that 

g \z\ for \z\ < 1 [739] 

in which the equals sign holds only if it holds identically. 

This result is readily translated into an expression involving X and 
Z(X) since it states, with reference to Fig. 51, that to any concentric 
circle within the unit circle of the z-plane there corresponds a concentric 


2-plane ii;-plane 



Fig. 51. Relevant to the derivation of the properties of a p. r. function expressed 

in polar form. 

circle within the unit circle of the TC'-plane which is at least as small or 
smaller. If one considers the value p = A, which implies no restriction 
since the value of A is arbitrary, one observ^es by inspection of the figures 
that the following condition obtains: 

|(?| ^ |,^| for |,^| g [740] 

This result may be written in the alternate form 

larg.Zl g larg. X| forO < [arg. x| g ^ [741] 

Again the equals sign in the first of these inequalities holds only if it 
holds identically. 

The remarkable part about this result is that although it appears to be 
stronger, it nevertheless is contained in the statement Re[Z\\)] ^ 0 for 
RcQs) ^ 0, expressing the px>sitive real character of Z(X). Since the 
present result is readily seen to include this statement in terms of the 
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real parts of X and Z(X), one concludes that the two forms of expressing 
the positive real character of Z(X) are entirely equivalent. The statement 
in terms of the angles of X and Z(X), just derived, is a translation of the 
one in terms of real parts into its equivalent polar form. 

An additional inequality may be obtained from these considerations. 
With reference to the transformation 733 and the polar representation 
737 for X, let p = A. This choice is always possible since the value of A is 
arbitrary. Equation 733 then yields 

[742] 

The condition 739 may therefore be written 

^ tan ^ for 0 < <^ < ^ [743] 


Using the inverse of the transformation 734, which reads 

Z _ 1 -b 
B I — w 

and taking note of Eq. 735 ,one obtains the condition 


[744] 


1 — tan 


1 + tan 


4> 

2^ |^(X)| 

4>~ Z{p) 


1 + tan 


</> 


t 

2 , „ » 
» for 0 <(/.<- 


[745] 


For <l> = 7r/2 the lower and upper limits in this relation are zero and 
infinity, but for ^ — jr/4, for example, one has 


0.414^ 2.414 

^(p) 


[746] 


The restriction implied by the condition 745 is thus seen to illustrate 
another interesting property of ix)sitive real functions. 

A property which is rather obvious, but nevertheless practically useful, 
is expressed by the statement: 


// Z(X) and W(X) are positive real func¬ 
tions^ f(^) = Z(W) is again positive real. 


[747] 


In other words, a positive real function of a positive real function is 
also positive real. As an example one may consider the simple positive 
real function 

lr(X) = i 


[ 748 ] 
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The above statement asserts that if Z(\) is positive real, Z(l/X) is also 
px)sitive real. Again, one may have 

H^(X) = X + ^ [749] 

which is readily recognized as being positive real. Then if Z(X) is positive 
real, one may state at once that Z(X + [1/X]) is likewise positive real. 
Use of the condition 741 enables one to make the further assertion that 
the angle of the function Z(X + [1/X]) must, for every value of X in 
the right half plane, be smaller than the angle of Z(X). 

PROBLEMS 

1 . Verify that the real and imaginary parts of the function 

cos y -f je^ sin y 

satisfy the Cauchy-Riemann equations. Show that this function must be e* where 
s = X +yy. 

2. Using this reasoning, show that 

sin X cosh y -hj cos x sinh y * sin s 
cos X cosh y + y sin x sinh y — cos z 

3 . Let the sphere in stereographic projection be of radius 1 , so that its equation is 

- 2r = 0 

Show that the point 77, f on the sphere corresponds to the point 

"" 2-f ^ 2-i- 

in the plane f =• 0 . Show that if = — 4 , 21 and 22 correspond to diametrically 
opposite points. 

4 . For w s'm z - u +72^, sketch the curves u == constant and v — constant in 
the 2-plane and verify that they are orthogonal. 

5 . Actually integrate 2“ dz around the following contours, and verify that the results 

are zero: (a) Around the square having vertices at 1 1 —7, —7, —1 -f-j. 

(b) Around the triangle having vertices at 1 -f 7, — 1 — 7, — 1 -h7. 

6. Carry out the integration for (I/2) dz about the following contours; (a) The 
square with vertices at 1 , 2, 2 4-7*, 1 -{-7. (b) A circle of radius 1 about the origin as 
center. Why is the result not zero in part (b) ? 

7 . As an example of analytic continuation, consider the following: (a) Find the 

function represented by 1 -h 2 + 2^ • • • . (b) Determine its circle of convergence, and 
find the singularity on the circumference, (c) Determine the series for this function 
about the point 2 = — (d) Verify that this series converges for points for which the 

original series diverges, in particular at the point 2 = 

8. As an example of a function having a natural boundary, consider 

f(z) = 1 + 2^ -f 2^ -f 2* -F z'® H- 
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(a) Show that the radius of convergence is 1. (b) Verify that for every point of the 
form k and p being integers, all terms after will be 1, so that the function is 

singular at such points, (c) Show that these points are dense on the unit circle, in the 
sense that there is no interval free of them. As a consequence the function cannot be 
continued outside. 

9. In deriving the Laurent series for a function, the integral formula for the coef¬ 
ficients is not practical. The function 

sin z 


has a pole of order ^ - 1 at the origin, and its Laurent series would be found by 
dividing the series for sin z by z*. Using this idea, find the Laurent series for 

cos TTZ 

about the point z ~ 1. 

10. In deriving a Laurent .series, the method of partial fractions is useful. For 
example find the Laurent series for 

1 

z=^(l - z) 

about z = 0 and z = 1. What are the regions of convergence? 

11. Sketch the lines u = constant and v = constant near the origin for the functions 

w - \ and w; = 1 z^ 


which have saddle points there. 

12. Find the value of the integral of esc z dz taken around the following contours: 
(a) A circle of radius 1 and center at the origin, (b) A circle of radius 4 and center at 
the origin, (c) A circle of radius 2 and center at z = 2. 

13. Find the integral of sin z/z* for k = 1,2, 3, and 4 taken about a circle of radius 
1 and center at the origin. 

14. Determine the polar and rectangular forms of the function 


m = 


sinh nz 
n sinh z 


in which n is an integer, and show that the Cauchy-Riemann equations are satisfied. 

15. Show that f{z) in the foregoing problem is an entire function, and determine 
the distribution of its zeros. 

16. Supp)ose the derivative of/(z) - «(x,y) jv(x,y) is written 

-f = a + jb = 

dz 


If /(z) satisfies the Cauchy-Riemann condition equations, show that one may have 


du . , dv 

a = - and h = 
ox ox 


or 


dv , , du 

a ~ - - and ^ ™ 

oy dy 


P'or the following functions 

z^\ \/s; cosh 2; sinhz; 


Jz. 


In z; 


cos'"* z 
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compute the polar form of df/dz through first forming u and v and obtaining a and b 
by one or the other of the above pairs of relations, and alternately through forming 
djf/dz directly and then putting the result into its polar form. Check the three results 
for each function. 

17. Derive the following identities: 


(a) 

II 

1 

j sin z 


(b) 

sinjz = 

j sinh z 


(c) 

It 

1 

cos z 


(d) 

cosjz = 

—cosh z 


(c) 

tanh^z * 

= j tan z 


(f) 

tanjz = 

j tanh z 


(g) 

sinh"“^yz 

= j sin~' z 


(h) 

sin“^yz 

* j sinh"”' z 


(i) 

cosh’^z 

= j cos""^ z 


(j) 

cosh ^ jz ^ j jz 


(k) 

tanh“^yz 

=* j tan““^ z 


(1) 

taiT^jz 

= j tanh"^ z 


(m) 

sinh“' z - In (z -f Vz^ -h 

1) 

(n) 

cosh“^ z 

= In (z -f- \/z^ - 

-1) 

(o) 

tanh“"^ z 



(P) 

coth"^ z 



(q) 

sin~‘z = 

- In (jz -1- VT — 
J 

1*) 

(r) 

cos“^z = In (z -f Vz^ 
J 


(s) 

tan"“^ z =* 



(t) 

cot“^ z = i In ^ 




2j Vl -J2/ 



\jz + 1/ 



18 . Considering the function = In z, draw in the w-plane the figure corresponding 
to the rectangle in the z-plane defined by 

(x = - 3 ; 1 g y ^ 2 ) (x ^ 3; 1 ^ y g 2 ) 

y = 1) (-3 g x g 3 ; y « 2 ) 

19 . In a complex plane draw the figure bounded by arcs of concentric circles with 
radii n = 10 and r2 = 30 centimeters, and radial lines making angles of 30 and 60 de¬ 
grees with respect to the positive real axis. Using the function zr = In z, transform this 
figure into a rectangle and specify the equations of the straight lines forming its sides. 

20. Considering the function w = sin“^2 = u +jv, show that the lines u = 
constant and v = constant in the zy-plane are transformed respectively into central 
hyperbolas 

_yi_ = 1 

sin^ u cos^ u 

and central ellipses 

y2 

cosh^ V ^ sinh^ v ^ 

in the z-plane, and demonstrate that these families are confocal and orthogonal. Draw 
a representative number of these loci. 

21 . With reference to the conformal map described in the previous problem, con¬ 

sider the strip —7r/2 < u < 7r/2 in the w-plane and determine the regions in the 
z-plane corresponding to the portions of this strip defined by z» > 0 and v <0 respec¬ 
tively. The closed rectangular boundary in the w-plane joining the four points « = 0, 
v\^ 0.^2; M 5= 1, V =s 0.002; « =* 1, « 0.02J « = 0, v ~ 0.02 is traversed counter¬ 

clockwise. Determine the corresponding contour in the z-plane and indicate the 
direction of traversal. 
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22. Continuing the study of the function w = sin“^ z, describe the structure of its 
Riemann surface pointing out the location of branch points, appropriate positions of 
branch cuts, and the number of leaves in the surface. How many leaves of the Riemann 
surface are occupied by the closed contour in the z>plane corresponding to the rec¬ 
tangular one in the w-plane joining the four points: 

Stt , Stt ^ in Stt 

—,r»l; = 

23. Consider the function w - l/z and show that it transforms circles in the 
z-plane into circles in the it^-plane and vice versa (including straight lines as limiting 
forms of circles). Draw a family of circles in the ii>-plane corresponding to the straight 
lines y = kx -h c (with ^ and c real) in the z-plane, choosing a fixed value for k, for 
example, it = and various values for c as, for example, c = 0, ±1, ±2, etc. Alter¬ 
nately consider the families of straight lines x - constant and y = constant. 

24. For the function w == z/(a - z) with a »= 1 map the loci in the z-plane 

corresponding to the lines V = -f ~ 1 in the 7i>-plane. Indicate 

corresponding directions of traversal by placing arrows on the loci. By shading indicate 
the regions in the z-plane corresponding to (a) that part of the w^-plane below^ the line 
V - (b) that part of the 2 £^-plane below v - 3^ and above the real axis. 

25. The arc of a circle of radius 10 and center in the first quarter of the z-plane 
passes through the points 31 : = 0, y = 0 and x = 3, y = -1. Show that the region 
enclosed by this arc and the chord passing through the same two points may be 
mapped in the 2 (^-plane as an angular slit with its vertex at the origin by means of the 
transformation w - z/(a — z). Determine the complex value of the constant a and 
calculate the angular aperture of the slit as weD as its orientation in the ii>-plane. 

26. A region A in the first quadrant of the z-plane is bounded by the arcs of three 
circles passing through the origin, two of them having their centers at the points 
X = 1, y = 0 and x = 2, y =0, whereas the center of the third circle is at the px)int 
X - 0, y = 2. A second region B is bounded by the arcs of two circles passing through 
the origin with centers at x = — 2, y = 0 and at a: = 0, y = — 1. Show that each region 
can be transformed into a rectangular strip in the w^-plane through the transformation 

= 1/z and determine the boundaries of these corresponding rectangular regions. 

27. Show that the equation 

d (x^ -f y*) -I- Bjc + Cy -f D * 0 

in which the constants are subjected to the condition 

-f C2 ~ 4AD > 0 

is a general equation for circles and straight lines, and that this property is preserved 
when z = x -f^y is replaced by 1/z. 

28. For the transformation 

1 — z 

w =- 

1 +2 

let z = and consider the concentric circles r =» constant and the radial lines 
6 = constant, and compute the location of the center and the radius of each corre¬ 
sponding circle in the 7£;-plane in terms of r and 0 respectively. Plot a representative 
family of curves in each plane. 

29. For a function w f(z) ^ u A-jv, satisfying the Cauchy-Riemann equations, 
loci for u ~ constant and v *= constant are plotted in the z-plane. If the slopes of these 
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curves are denoted by (dy/dx)tt -constant and {dy/dx)t -constant respectively, show that 
at any point these derivatives have negative reciprocal values and hence that the 
families of curves intersect at right angles. 

30. Study the function w = in the vicinity of the point Zq = h) 

through plotting in this region a number of curves corresponding to « = constant and 
V = constant for a — 5 4-^0 and = 0 

31. Let Vz = du/dx and Vy = du/dy be the velocity compK)nents of a conservative 
hydrodynamic field, u being the real part of the analytic function w = /(z). Show 
that the magnitude of the velocity is given by v - \dj/dz\. 

32. Write down the mutual conditions to be satisfied by two functions P(x,y) and 
Q(x,y) if the line integrals 

l'^(Pdx-Qdy) and J'^iQdx + Pdy) 


are to be independent of the path c, and compare the results with the Cauchy-Riemann 
equations. 

33. 5 is a path joining two points A and B in the comple.x z-plane, and zi, 22 , * • • , 
Zn — B are n uniformly spaced points along this path. The definite integral along the 
path is defined as 



n 

dz = limit J(zk) Az^t, 

«—► 00 At “ l 


with Azk ^ Zk - Zk-\ 


Show first that 


and thus that 


ri 


X) f{zk) Azjb 

A:-l 


^ i: 


|/(2jfc)l • \AZk\ 



< 


£ 1/(2) 1 • \dz\ 


34. With reference to the situation given in Prob. 33, sui)pose/(z) is bounded along 
S and that its largest absolute value on this path is M. Let the length of the path S 
between A and B be denoted by L. Show that 



^ ML 


35. Let /(z) be regular on and within a closed contour C. The length of the contour 
is L, 2 is an internal point, and L is the circumference of a circle whose radius is the 
minimum distance from z to the contour. By means of Cauchy’s integral formula, 
show that 

MI 

\f{z)\ ^ “p- {M defined in Prob. 34) 

Li 


36. By direct integration along the sides of a rectangular contour joining the points 
{x,y); {x + xo,y); (x -f xo,y + yo); (xj -f yo) check the relation 


/ 


dz =0 
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37. Consider integration of the function around a closed contour formed by 
two semicircles in the left half plane concentric at the origin, one having a large radius 
the other having a small radius p, and those portions of the imaginary axis joining 
the semicircles. The integral is effectively expressed as the sum of four parts corre- 
spending to the two linear path increments and the two semicircular ones for which 
% = and z = pe^^. Observing that the function is regular on and within this 
contour, obtain in the limit R—* «, p —► 0, the result 


j r* ^ 

0 y 



38, Compute the definite integral 



along a path consisting of the linear increment from the point 1 to the point \z\ on the 
positive real axis, followed by a circular increment concentric at the origin, expressing 
the result as the sum of two parts corresponding to these path increments. Thus show 
that the value of the integral equals In z. 

39. Consider integration of the function w = around a closed rectangular 
boundary joining the four points z - —a, z = a, z - a jb, z - —a jh^ a and h 
having positive real values, and express this integral as the sum of four parts corre¬ 
sponding to the four linear path increments. Using the result 



dx = 


obtain in the limit a 


CO the more general one 


s: 




cos 2hx dx = v/x 

2 


40. Integrate the function around a closed contour formed by the linear incre¬ 
ment from 0 to i? along the positive real axis, followed by the circular arc from R to 
^^y(r/4) and completed through a linear increment from to 0. Considering the 

limit 72 —► 00 and again using the value of the error integral given in Prob. v^9, obtain 
the result 


' cosx^dx » / 
0 uo 


sin dx 



which, with the substitution x^ = yields the Fresnel integrals. 

41. Expand the following functions in Maclaurin series: c', cos z, sin s, cosh z, sinh z. 

42. Through expansion in Maclaurin series, check the following expressions: 

gZ 

ln(l+z) = z- 2 + y- ;j+"- 


(1 + z)" = 1 + + 


«(n - 1) . n(n - l)(n - 2) 


1-2 




1-2-3 


z» + 


43. Using the result that the radius of the convergence circle of the pwwer series 
/(z) = no + + o*** + • • • + flnZ" d- 
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is given by 


R 



sl;ow that i? ~ for the series in Prob. 41 and i? = 1 for those in Prob. 42 . 

44. Find the radius of convergence of the following geometric series; 1 + « + 

4“ + * * * 4“ 2” 4" • * *. 

45. Expand the function (2^ — 1 in a power series about the points a « 0, 
z - jyZ =4 , and find the radius of convergence in each case. 

46. Utilizing th< fact that the convergence circle reaches to the nearest singularity, 

compute the radius of convergence of the function [(z — 1)(2 4-2 ~y3)(z^ 4- 9)]“^ 
expanded in a power series about each of the points: 2 = 0, 2 = 0.2 — 2 - jl, 

2 = -8. 

47. Assuming that the function given in Prob. 46 is expanded in power series about 
points on the line y ^ - 2 x lying at a: = 1, 0, —1, —2, make sketches showing the 
various regions of convergence and their overlapping portions. 

48. Show that the expansion of the function 






about appropriate points Zq on the positive real axis reads 

and verify that the radius of convergence is i? = |2o "" l|* 

49. Using the result 


s: 




- for X >0 
2 


find the values of the following integrals: 


^ BO 

f cos yt dt I sin yt di 

0 t/o 


50. Show that the function 1/(1 4- Vz — 2) has two different power series expan¬ 
sions about the point 2=0 with radius of convergence equal to 1 and 2 respectively. 

51. Using the formula for the coefficient of the Laurent series, and assuming 
that the points f and 20 are not functionally related, obtain the relation 

n 4- 1 dzo 

applicable for negative as well as positive integers «. 

52. Consider the rational function 




Pxiz) 

P2{Z) 


in which Pi and P 2 are finite polynomials. Assume that P 2 {z) has a zero of multiplicity 
a at 2 = Zo and write ^ 2 ( 2 ) = (2 — zaYF^iz). Letting f — 20 = in the formula 
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for Laurent coefficients and recognizing that p may become arbitrarUy smaU, obtain 
the result 


h = 

Fs(so) 

Also show that the formula yields b-^a+p) = 0 for aU positive values of p, and using 
the result of Prob. 51, get 


6- 


(«—j>) 


1 




(a - l)(a - 2 )-- - (a - p)dzo^ 
which contains the specific result 

1 


6-1 


(a — 1 ) 


b-a 


53. Considering the Laurent expansion of the rational function described in Prob. 
52, show that the coefficients * * • 6_i have real values when 2o is real and that they 
have conjugate complex values for conjugate values of zq. 

54. Show that the Laurent expansion of the function 

/(z) * 

about its essential singularity at z = 0 has coefficients given by the formula 

1 

6n(0 = {n4> — tsm<l>) d4j> 

lit Jq 


which are Bessel functions of the first kind. 

55. Suppose/(z) has an isolated singularity at z = Zo and the radius of convergence 
for its Laurent expansion about this point is R. For points on a concentric circle about 
Zo with radius r < R show that the series representation takes the form 

oo 

/(z) = .4o + s {(^» + ^-F.) cosn<^ +j{An - A-„) sin mf)} 


in which 


A„ - ^ + re>*)e-^’^d^ 


56. Find Laurent expansions for the following rational functions about their poles: 

5z^ 4 - 3z 4 - 2 1 3z 

4z^ -f 8 z + 1 4z^ + 8 z -h 1 4z* + 8 z -h 1 

57. Find the partial fraction expansions of the functions given in Prob. 56. 

58. A polynomial P{z) has a double zero at z = 1 , a zero at z *= j, and a zero at 
z « 3(1 —y). Assume the coefficient of the term z^ to be unity. Find the Laurent 
series for \/P{z) about z «» 1. 

59. Compute the residues of the following functions in their various poles: 

5z^ -f z + 1 

7(z2 -P .3z -f 8) z2 - 3e^^/« T 

60. A rational function /(z) has simple poles at the points z = Zi, zj, * • • z„ only, 
with the residues 62 , •' • kn respectively. Find analytic expressions for the residues 
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of the function 


4/{z) 


f/(z) 


2(* - f) 

in all its poles assuming that f does not coincide with any of the points Zi • • • a,. 

61. Continuing Prob. 60, evaluate the contour integral 


lirj 



in which C is a circle about the origin with a radius R sufficiently large to enclose all 
the poles of ^( 2 ). if f{z) is regular at infinity, show that 


f{z) dz 


z^ 



► 0 as i? 


00 


and hence that the value of the above contour integral must be zero. Thus obtain the 
following form for the partial fraction expansion of /(z): 

m =/(o) + t + 


62. Generalize the result of Prob. 61 to the extent of allowing f(z) to possess an 
unlimited number of isolated simple poles (it is then no longer a rational function, 
of course). Through choosing the circular contour in such a way that no pole lies upon 
this path at any stage in the limiting process indicated by i? , conclude that the 
above partial fraction expansion of f(z) yields (in the limit n --♦ «) a convergent 
series (theorem of Mittag-Leffler), Apply the result to verify the following expressions: 



Convert these into summations over positive integers only. 

63. If a rational function has a zero at infinity with a multiplicity of two or more, 
show that the sum of its residues is zero. 

64. Find the values of the contour integrals 



when the contour C is defined as: (a) a circle of radius R < 5 with center at the origin, 
(b) a circle of radius R > 5 with center at the origin; (c) a triangle with vertices at 
the points — 6 , 76 , — 76 ; (d) a triangle with vertices at the points — 6 , 76 ,/ 10 ~® 

65. Show that the function 


2 ^ -f (— a -f 6 + c)z^ — (ab -f- ac — bc)z — abc (d“ ab ac be) (z — a) 

has a removable singularity at the point z = a through demonstrating that {z -- a) X 
f{z) is regular in this point. Compute the residues of f{z) in the remaining poles. 
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66. Considering the function 




1 

. 1 

sm- 

z 


within a circle of radius p about the origin, show that for a nonzero p however small, 
the circle nevertheless encloses an unlimited number of poles. 

67. Starting from the definition of the Tschebyscheff polynomials 


Tn{z) = 


cos (n cos'”* z) 

2n~l 


derive the alternate relation 

^ /-X 4-7V 1 ~ 2 ^)” -f- (2 1 ~ 2 ^)” 

and show that these functions are finite polynomials in 2 . 

68. Find the points of stagnation of the function 

/(«) = Po +i ^ In 2 

in which vq, R, and C are real constants, and map their locus in the 2 -plane as the 
quantity C/(4TrvoR) varies continuously from — « through zero to «. 

69. For any function w =/( 2 ) = u(x,y) -l-jv(x,y) satisfying the Cauchy-Riemann 
equations, regard u(x,y) and v(x.y) as representing altitude functions and thus 
defining a pair of surfaces si and S 2 ^ Show that a maximum or minimum in the altitude 
u coincides with a maximum or minimum in the altitude v and with a saddle point of 
the function /(z). 

70. Find the saddle points of the function 

/(z) = 

in which /, a, and b are real constants. Show that they always lie in the real or imagi¬ 
nary axes and that their positions are controlled by the ratio //a. 

71. Inside a closed contour C the single-valued function /( 2 ) is regular and con¬ 
tinuous except at poles in the points ai, 02 , — an with the residues ^2 * * • If is 
the length of this contour and M is the maximum absolute value of f{z) on the contour 
show that 

bk 
1 

72. Consider the rational function 

J( ) ^ H--f flm2”* 

bo 4” ^i2 4“ b^z^ 4" * * * 4" bnZ^ 

and let k\j * kp (p ^ n) be the residues in its poles which may or may not 
be simple. C is a circle about the origin with radius R large enough to enclose all the 
poles. Points on this circle are denoted by 2 = Show: 



< 

27r 
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(a) That 


2r|A, + A, + • • • + *,| ^ |/(*)t d4, 


(b) If w ^ {fit 4" 0 that 

(^1 -f ^2 + • • * + kp) — 0 

(c) If n ~ (m H- 1) that 

(*i + +•••+*,) = ^ 

On 

How can one obtain an expression for the sum of the residues when « < (w -f 1)? 

73. Evaluate the following integrals involving functions of a real variable x 


r- xUx ^ r- dx 

Jo X* i ^ Jo X® 4- 1 


through replacing x by the complex variable z - x -\-jy and using the methods of 
contour integration, choosing as the closed contour the real axis from --R to R and a 
semicircle of radius R which is regarded as having unlimited magnitude Consider 
whether the semicircle should lie in the upper or lower half plane, and show that the 
contribution of the semicircular path increment to the value of the integral is negligible. 

74. 2 = is a point on the unit circle about the origin, and rp (cos sin 6) is a 
rational function of sin 6 and cos 6. Show that 

'*2v 


j" \p dd = ^ J{z) dz 


in which f{z) is a rational function of z, and C is the unit circle about the origin. 

75. Using the results of Prob. 74, verify the following integration 

"2- de 


£ 


_ It 

1 4- — 2a cos B |a^ — l| 


76. Within a closed contour C the function f{z) has simple poles at the j>oints 
* 1 , 22 , * * • 2n with the residues h\, ^ 2 , * * * respectively. Inside the same contour the 
function cot ttz has p simple poles. Show that 

\ r V n 

T- r /(*) trzdz ^ 2 f{m 4- 4- tt £ h cot wZk 

^jJc *-1 ik-l 

in which tn is an appropriate integer. 

77. Through replacing x by z, choosing a closed contour consisting of one large 
semicircle of radius R, a small one of radius p (both in the upper or lower half plane) 
confluent with portions of the real axis, and showing that contributions due to integra¬ 
tion along the semicircular path increments vanish in the limits J? « and p 0, 
obtain the result 


x; 


(In *)* 

“ “T 


It is now proposed to find the integral of the same function between the limits 0 and 
through considering the change of variable x x) in the integration over - « to 0, 
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noting that 

[In (-*)]* = (In* » (In*)* - ir* ±j2i:\nx 

Thus, after obtaining the collateral results, 

X "_d* IT 
1 - 


1 +** 


and C - dx = 0 

Jo 1 + ** 


show that 


/■ 


(In a;) ^ j TT* 


78. By means of complex integration, following a pattern similar to that suggested 
in Prob. 77, check the values of the following definite integrals 


£' 


COS X 
a* 


dx 


2a 


£ 


sm X , Tre ® , 

; dx = ---— smh a 


x^ -f 


2a 


Express cos * and sin z in terms of the exponential function and correspondingly 
represent each integral as a sum of components. Choose composite contours consisting 
of the real axis and a semicircle of radius i? , placing the latter in the up{)er or 
lower half plane according to the requirement that this path increment shall contribute 
nothing to the value of the contour integral. Note that the second of the two integrals 
above remains proper for a -*0 If the constant a is regarded as real throughout the 
process of evaluation, is the result nevertheless still valid for any complex a-value, 
for example, for a pure imaginary value? 

79. If f(z) is a rational function having a zero at infinity with a multiplicity equal 
to or greater than one, and if F(t) is a real function of the real variable t w'hich is zero 
for / < 0 and has the property that »0 for / -♦ oo (assuming z to have a 

positive real part), the following pair of mutual integral relations hold: 

F(<) = 2 ^ j['' /(*)«" dz f(z) = jT ^ F(t)e-“ dt 


Check these relations for the following pairs of functions: 


“ (* + a)"+‘ 

F{1) = re-o* 

/(*) “ ,2 + a* 

F{t) = sin at 


F(t) = cos at 

f( \ 

“ (* +a)* +6* 

F{t) = e~“ cos bt 

The first of the two integrals is to be evaluated using complex integration along a 
closed contour consisting of the imaginary axis and a large semicircle of radius i? —► « 
lying in the left or right half plane according to whether ^ > 0 or / < 0 (see Art. 26 of 
Ch. VII). The second integral in the above pair is to be evaluated according to the 


methods of real integration. 

80. Expand the following rational functions in partial fractions and check the 
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relations regarding the residues as stated in parts {b) and (c) of Prob. 72: 

^ 1) z(z^-h2z - 1) 

(a^’ - 2j(z^ - a - 1) ^ ^ - 3)*(a + 8) 

(a - 3)2(a + 8) (a - 2)‘(z - 3)» 

81. Discuss the structure of the Riemann surface associated with each of the 
following functions: 

(a) w ^ ^z (b) - 

(c) w - \/ (z — a)(z — b)^ (d) w = \/(s — 5)( 2 ^ -f 62 + 13) 


pointing out the location and order of branch points and other singularities as well as 
the character of the point 2 = «. 

82. Discuss the Riemann surfaces in both the w- and 2 -planes associated with the 
function w - 

83. For the function w — consider the leaves of the Riemann surface defined 
by the statements: 

—TT < arg. 2 < TT corresponds to leaf I. 

TT < arg. 2 < Stt corresponds to leaf II. 

37 r < arg. 2 < 5t corresponds to leaf III. 

In the u>-plane plot loci corresponding to the following straight lines in the 2 -plane: 

(a) Parallel to the real axis at distances 0.1 and —0.1 from the origin and lying in 
leaf I. 

(b) Parallel to the imaginary axis at the distance 0.1 from the origin and lying in 
leaf III. 

(c) Parallel to the imaginary axis at the distance —0.1 from the origin and lying 
in leaves I and II. 

84. For each of the following functions w = f{z) construct the algebraic equation 
F(z,w) = 0, which generates the complete function, and from this equation determine 
the inverse function 2 = 


(a) w = \/ 2 ^ — 1 (b) w; = 2 -f (c) w = 

Describe in each case the structure of the Riemann surfaces in the w- and 2 -planes, 
pointing out the locations and multiplicities of branch points, branch cuts, etc. 

85. Recognizing that each of the complete functions w = \/z and W - y/z — 1 
has two branches, construct the algebraic equation that generates the function U =» 
w -f W. Determine this function as well as its inverse 2 =* </>(£/), and discuss com¬ 
pletely the Riemann surfaces in the U- and 2 -planes. 

86 . The expressions 

w ~ and w « \/l — sin* 2 

represent pairs of single-valued functions rather than multivalued functions. Demon¬ 
strate the truth of this statement through showing that the two functions of a pair 
cannot be obtained one from the other by the process of analytic continuation. 


4 


1 

1 — 2 * 
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87. Through the use of Hilbert transforms solve the following: 

(a) given M(0,y) = iyf 

(b) given «(0,y) - find .(0,y) 


(c) given M(0,:y) 


1 -f — for —yi < y < 0 
3'i 

y 

1 ~ forO < y < yi find 7(0,y) 

y\ 

0 for \y\ > yi 


(d) given M(0,y) 


(e) given w(0,y) 


3^1 


for —yi < y 


for 0 < y < yi 


a for \y\ > yi 


find i’(0,y) 


-1 + 


jy + yi) 


5 

1 (v — yi) , 5 

J — for yi - _ < y < y, + 

0 I 


for -yi - - 

h 


< y < -yi 


1 for |y| < yi — 2 
0 for ly| > yi + ^ 


(f) given r(0,y) 


WTT 

-V for — vi < V < Vi 

yi ' 

— WTT for y < — yi 
WTT for y > yi 


find u(0,y) 


8 

2 


find : iH.y i 



CHAPTER VII 


Fourier Series and Integrals 

1. Finite trigonometric polynomials 

In discussing the convergence of Fourier series it is necessary to have 
compact expressions for their partial sums. For this reason, and also 
because one finds expressions of this sort useful in various other problems 
having to do with trigonometric series, a number of formulas are de¬ 
veloped whereby a variety of finite trigonometric polynomials are given 
in closed form. 

In view of the well-known geometric series 

= 1 + z + + Z® H- [1] 

1 — z 


and 


„n-hl 

- - = 2^+1 + -I- 


one may write 


1 _ 

—- = l + z + z® + -- -+z" 


[ 2 ] 

[3] 


and 


1 1 - z”+* 


= 1 + Z-* + Z-® H-+ z“" 


z" 1 - z 

By addition and subtraction respectively these equations yield 
1 - z”+^ 

1 - z 

and 


[4] 


1 - z’ 


,n+l 


1 — Z 
Letting 

and noting that 


(1 + Z-") = 2{1 + i(z + Z-*) + I(z2 + 2-2) + • • • + 

§(z» + z-)l [5] 

(1 — Z“”) = 2{|(z-z“*) + 2 (z® — Z“®) d-1- ^(z"-z"")l [6] 


2 = 6 ^* = COS X +J sm X 
gn _ ^jnx _ ^ j 

436 


[7] 

[ 8 ] 
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one finds for example, that 

(1 + Z-") = 


1 _ 2 »+l 2 ^n+l )/2 _ g-(n+l)/2 


1 — Z 


,112 _ _-l/2 


2 sin (m + 1) - cos « 

. * 
sin - 
2 


X 


♦/2^ 


[9] 


By use of well-known trigonometric identities, this may further be 
transformed as shown by 


2 sin (n -f- 1) ~cosn^ 


sin (2n -|- 1) 


+ 1 


sin 


sin 


[ 10 ] 


The use of manipulations of this sort enables one to obtain from Eqs. 
5 and 6 the formulas 


j sin (2» -f 1)^ 

_ _|-= 1 cos X -f cos 2* -f • • • -b cos nx [11] 

2smj 

and 

- cot --- sin a: -f sin 2* -f- • • • -f- sin n* [12] 

2sm- 

The compact forms thus obtained for the finite trigonometric polynomials 
given by the right-hand sides of Eqs. 11 and 12 are useful in a variety of 
practical problems as well as in connection with various theoretical dis¬ 
cussions regarding Fourier series. Other formulas are readily obtained 
from Eqs. 11 and 12. For example, replacing the variable x in Eq. 11 
by (a: + t) yields 

j (-l)»cos(2«-|-l)| 

- H-= 1 — cos X -f cos 2a: — cos 3a: -b • • • 

I « * 

2cos- 

-b ( —1)“ cos»a; [13] 

which is the same polynomial but with alternating signs. Making the samo 
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change of \ ariable in Kq. 12 gives 


! - 1)" ■’ sin {In -f- 1) 


2 2 + 


=i sin * — sin 2x + sin ix 


( — 1)" * sin no: [14] 

Subtracting Eq. 13 for n odd from Eq. 11 yields a formula for a cosine 
polynomiaJ with only odd integer multiples of x, thus: 


sin (n + 1 )x 
2 sin X 


cos X + cos 3a: + cos 5a: + • • • 4- cos nx [IS] 


Similarly, adding Eq. 12 and Eq. 14 for n odd yields 
1 - cos (n + 1 ).c . , . , . . r . 


sin x + sin 3a + sin 5x + ••• + sin nx [16] 


in which sin* (« + 1)2 be written instead of ^[1 — cos {n + l)a] 
if desired. 

In Eq. 15 one may introduce the change of variable a—>a f ^ and 

obtain a sine polynomial with odd multiples of a and alternating signs, 
thus; 


— 1)’" sin (n + 1 )a 
2 cos a 


sin a — sin 3a + sin 5a — 


+ ( — 1)^” sin nx [17] 


Making the same change of variable in Eq. 16 yields 
1 + (-1 cos {n + Da 

--- 1 _ _ ^ _ (.Qg 3 j. _|_ pQg 5 ^ _ . . . 

2 cos a 

+ ( —1)^"”'^^^ cos «a [18] 


In these last two transformations it is significant to note that Eqs. 15 
and 16 apply only to odd integer values of n, so that (« + 1) is an even 

TT 

integer. Hence sin (n + 1) =0; whence 

cos {n +1) ^a -f = cos (« +1 cos (« +1 — sin (« +1 )a sin («+1) ” 

= (_l)(«+i)/2 cos {n-^l)x = -(-l)("-')/2 cos («+l)a [19] 
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sin (« + l)^x+0 = sin (« + l)a:cos (»+!)“ +cos (» 4-l)a;sin (» + l)^ 
= ( —sin («+l)a: = — ( —sin (w+l)* [20] 


2. The orthogonality relations and their significance in the 

EXPANSION OF ARBITRARY FUNCTIONS 

The trigonometric functions, in common with many other kinds of 
so-called systems of proper functions, j)ossess a very interesting and 
important property which greatly facilitates the process of represent¬ 
ing an arbitrary function over a given interval by a series in terms 
of proper functions. Since the underlying principles of this process have 
a broad significance in the solution to i)rot)lems in potential theory 
and wave motion, a few rather general introductory remarks are in 
order. 

For detailed discussion of the derivation of the following fundamental 
differential equations and for physical interpretation of them, the reader 
is referred to other portions of this reference series, the chief interest 
at the moment being focused primarily upon their purely mathematical 
import. In dealing with problems in potential theory, in which a desired 
potential function is a function of the space co-ordinates {x,y,z) alone, 
Laplace’s equation 

= 0 [ 21 ] 

is found to govern the behavior of that function, whereas in problems 
involving wave motion, in which the time co-ordinate also is involved, 
this equation is modified by the apjjearance of an additional term so that 
it reads 

1 

'''T’ - 7, - 0 m 

In the first of these two cases the potential is static, whereas in the 
second it is dynamic — that is, it varies with the time as well as with the 
space co-ordinates. In other words, a problem in wave motion is simply 
a problem in potential theory with an added time co-ordinate. 

The form of the Laplacian operator depends upon the particular 
system of space co-ordinates used.’" In the commonest of these, the 


•See Art. 18, Ch. V. 
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ordinary rectangular Cartesian system, it is given by 

^ dy^ ^ dz^ 

In dealing with the so-called wave equation 22, the first step is to 
eliminate the time variable. This is done through assuming 

T? = Ve’^^^ [24] 


whence 


2T) 


SO that Eq. 22, after cancellation of the common factor reads 

VH^ + kn^V = 0 [26] 

in which* 

^ [27] 


In Eq. 26, as in Eq. 21, the function F is a function of the space co¬ 
ordinates only. 

The particular form of these equations now depends upon the system 
of co-ordinates used, and the choice of co-ordinates in turn depends upon 
the geometry of the physical system to which the equations apply. For 
a rectangular geometry the ordinary Cartesian co-ordinates are used; 
for a cylindrical geometry, cylindrical co-ordinates; for a spherical geome¬ 
try, spherical co-ordinates; and so on. Correspondingly, these particular 
forms of the equations are known by certain names, such as Bessel’s 
equation (for cylindrical co-ordinates) or Legendre^s equation (for 
spherical co-ordinates), and the particular types of functions which 
formally satisfy the equations are largely known by names which relate 
to the particular geometry of the physical system, such as cylinder 
fumtions (of which the Bessel functions are the so-called first kind) 
or spherical harmonics (also known as Legendre polynomials), and so on. 
These functions are referred to as the proper functions pertaining to the 
particular physical system under consideration, the simplest of them being 
the trigonometric functions which are the proper functions for systems 
having a rectangular geometry. In a single dimension this type of geome¬ 
try is that of a straight line, like a stretched violin string, for example. 

In terms of some parameter, like parameter n in sin nx and cos nx 

*The values ^ 2 » * * * » which usually are infinite in number, are determined from condi¬ 
tions which the function is required to satisfy at certain physical boundaries. 

The details of this process need not be considered at the moment. 
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or, in the case of solutions to the wave equation, in terms of the so- 
called proper values k„, these functions form a -set or system. In view of 
the linearity of the equations, it follows that a complete formal solution 
is given by a linear superposition of a set of these proper functions with 
different parameter values and arbitrary coefficients. Thus if <f>n(x,y,z) 
represents a proper function for the parameter index n, the solution has 
the form 

V = -h 02^2 + 0303 “I" • • • [28] 

which in general is an infinite series. The coefficients a„ are regarded as 
constants of integration which give the formal solution 28 the necessary 
flexibility of meeting certain boundary conditions set by the physical 
problem. 

Thus in a two-dimensional problem in static potential theory, for 
example, the potential °Q{x,y) may have to become identical with a 
certain function / (x) for y equal to a particular value, say y = 0, which 
characterizes a physical boundary. Or, in a problem of wave motion, the 
function °0{x,y,z,t) may, for the temporal boundary t = 0, for which 
(according to Eq. 24) °D = V{x,y,z), have to meet some prescribed 
function. For example, a stretched membrane for which °l? represents 
the displacement of various points from an equilibrium position is given 
a particular deformation from which it is suddenly released at an instant 
which is designated as / = 0, or an electrical transmission line (which 
involves a single space co-ordinate) has, at a given initial instant, dis¬ 
tributed upon it certain charges which give rise to a specific potential 
function versus distance along the line. These are referred to as initial 
or boundary distributions. Inasmuch as they may, in a physical system, 
be arbitrarily specified, the process of solution must be able to fit a series 
of the form given by Eq. 28 to a specified function of one or more of the 
independent variables. The fulfillment of these conditions may neces¬ 
sitate the selection of certain kinds of proper functions any of which 
formally satisfy the differential equations, such as the selection, for 
example, of a particular kind of cylinder function in the solution to a 
problem with cylindrical symmetry. 

In one dimension this problem takes the form 

fix) = aiPiix) -1- 0202(a;) + 0303(*) + • ■ • [29] 

in which f(x) and the functions 0n(*) are known but the coefficients a„ 
are to be determined so as to satisfy this equation. The problem here 
presented is determining the expansion of an arbitrary function/(x) in 
a series of specified projjer functions in such a way that the resulting 
series is in general a convergent one. 

The solution to this problem is either impossible, or possible only 
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through the use of ingenious artifices, unless the system of proper func¬ 
tions (or a derived system formed from linear combinations of these 
functions) satisfies the so-called conditions of orthogonality, which in the 
one-dimensional case are expressed by the equations 



<i>m{x)4>n(x) 


dx 


for f« = « 
0 for w 7 ^ 


[30] 


in which a and b are the finite limits of the region over which the function 
f(x) is specified.,The quantity r„ is ordinarily a constant and can be made 
equal to unity by the incorporation of an appropriate scale factor. This 
process is called normalization, and the resulting functions <l>n{x) are then 
spoken of as a normalized set of orthogonal proper functions or an ortho¬ 
normal set. 

The use of the term “ orthogonality ” in connection with the relations 
30 is suggested by the parallelism between these conditions and those 
characterizing an orthogonal matrix.* Since the relationship between the 
present problem and that presented by a set of linear algebraic equations, 
which is thus implied, has rather more than superficial significance, 
this item is discussed in greater detail. 

Regarding the partial sum 

Sn(.x) = aiPi{x) a2p2(.x) “h • • • -f- Onpnix) [31] 

corresponding to the series 29, and assuming that the function 5„(a:) 
is specified over the range a ^ x ^ b, one finds that a possible procedure 
for determining the coefficients a* such that the finite polynomial in 
terms of the functions <pkix) approximates the given s„{x) is to divide 
the interval a to b into n equal subintervals whose midpoints are the 
a;-values expressed hy a < xi < Xz <”•< Xa < b, and then to write 
the set of n equations 

5n(^l) = ai4>l(Xi) +a24>2(Xl) -I - 

SniXz) = ®l<f>l(*2) + ^202(^ 2 ) 4- * * • -f- a„<f>„(X2) 


Sn(Xn) = OlPliXn) 4“ 02*^2(*n) 4~ * * * 4“ On«^n(*n) 

in which the n coefficients a* are regarded as unknowns. The values of 
the coefficients thus determined, when substituted into Eq. 31, yield a 
function s„(x) which has the correct values at the selected points • • • Xn 
within the prescribed interval. At any other points, not much can be 
said about the degree of approximation afforded by the finite sum in 
Eq. 31. However, by taking n sufficiently large, and assuming for the 
moment that 5„ (x) is a smooth function, one may expect a solution which 
fulfills the requirements of a given physical problem. Indeed, as n is 

*See Ch. 11, Art. 6, and Ch. Ill, Art. 4. 
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chosen larger and larger, one may expect a closer and closer approxima¬ 
tion to the partial sum Sn{x), which is ultimately identified with the 
specified function f{x). 

Such a process of solution requires, for a finite n, the inversion of the 
matrix 




07i (X} ) 

01 

02 (*^2 ) * 

0n (‘ 1*2 ) 

_01 (■^n) 

<i>-AXn) • ■ 

07t {x ri ) __ 


. [33] 


which in general is a laborious task, and becomes hopeless if not impossible 
as n is increased without limit. However, if tliis matrix is an orthogonal 
one, its inverse is simply giv'cn by the transpose of the matrix 33. The 
solution for any n is then immediately written down. 

The orthogonality conditions for the matrix 33 read* 


^ 0r {^k ) 


j 1 for r == s 
[O for r ^ s 


which are readily recognized as having the same fonn as the relations 30. 
Idle solutions to Eqs. 32 are then given by 

n 

k^l 

This result may be obtained through multiplying Eqs. 32 successively 
by 03 0s(^ 2)1 * * ' 03and adding. In vdew of the conditions 34, 
the sums of all the columns vanish except that of the .vth, which yields 
Us, whereas the sum of the left-hand members is seen to be given by the 
right-hand side of Eq. 35. 

The equivalent solution for the coefficients in the infinite series 29 is 
obtained through multiplying this series by 0 s (x) and integrating over 
the region a ^ x ^ b. Then if the conditions 30 hold with = 1 , there 
results 


o. = jT dx [36] 

which represents the desired solution. 

In order to derive the orthogonality conditions for the trigonometric 

are the orthogonality conditions for the columns only. The corresponding ones for 
the rows arc not needed for the present discussion. Indeed, it is actually not necessary for 
the nuitrix to be orthogonal since the existence of orthogonality conditions for only its columns 
is sufheient. 
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functions it is convenient to write them in the exponential form 

fein - c-''"*) [37] 

2j 

cos ^ [38] 

whence 
sin mx sin nx 

sin mx cos nx 
and 

cos mx cos nx 


~ ^ ^ >(m+n)ar _ ^‘(m—n)a? _ j-^pj 

-- J_ ^giCw+n)* ^ ^y(m~n)af __ yCw~-n)x^ 

4/ 


1 


^giim+n)x _j_ g—j(.m+n)x ^ ^{m—n)x _|_ g—j(,m—n)x'^ 


Next it is observed that 

ei^‘dx = — \ 

3^1, 



gika^g}k2w _ j) 

jk 


[42] 


Since = 1 for all integer values of ky the numerator in this result is 
zero for all )fe-values. The denominator is not zero except for k = 0, 
Hence the value of the integral in Eq. 42 vanishes for all ^-values except 
k = 0 , when the right-hand side of this equation assumes an indeterminate 
form. The latter is readily evaluated if the limit A —> 0 is considered to 
proceed gradually. For small values of k the exponential may be 
replaced by a few terms of its Maclaurin series, giving 


£ 


'0+2ir 




€^■*“(1 +jk 2 v +-1) 

jk 


2v 


[43] 


Thus it becomes dear that 



2*' 
. 0 


for ^ = 0 
for ^ 7^ 0 


[44] 


This is an important property of the exponential function. 

By means of the expressions 39, 40, and 41 it is now readily seen that 


J sin mx sin nxdx = ^ 

\±ir 
[ 0 

for m = ztn 5 ^ 0 
for m 5 ^ =hw 

[45] 

^a+2r 

J sin mx cos nxdx <= 0 for all m and n 

[46] 

/•a-\-2T 

J cos mx cos nx dx = ■ 

f+ir 
[ 0 

for m = ±» 9 ^ 0 
for m 5 ^ :tn 

[47] 
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The fundamental range, so-called, which in the preceding discussion of 
this article is indicated by o ^ fc, is in the integrals 44, 45, 46, and 47 
seen to be any region throughout which the variable x changes by an 
increment of 2ir. The limits on these integrals are, therefore, arbitrary 
except that they must differ by 2ir (or a multiple of 2x). 

By the same process of analysis it is also readily found that 


I 




f2(-l) 


dx = \ 


<—1 


jk 


for k odd 

for k even except 


• for ^ = 0 


[48] 


in which v is any integer. In other words, if the fundamental range has a 
width ” of only v instead of 2 t, a result similar to the one expressed by 
Eq. 44 exists only for k even, and then only when the lower limit on the 
integral is an integer multiple (including zero) of x. 

If it is now observ'ed that, for any integers m and n, {m + n) and 
(m — n) are either both even or both odd, the result 48 together with the 
relations 39, and 41 shows that 

(r+i)» f 

sin mx smnxdx — { 2 

I 0 



for m = ±n 0 
for m ±n 


[49] 


and 


/ 


iv^Dx 


cos mxcosnxdx 


- 

+ “ for w = dbn 0 
^ 2 

0 for W rtw 


[50] 


in which v is any integer including zero. In other words, the trigonometric 
functions sin nx and cos nx also form orthogonal sets over a fundamental 
range which is only ir units wide. However, it is to be observed that a 
relation similar to the one expressed by Eq. 46 does not hold for a range 
of this width. 

If the range 0 < or < tt is divided into n equal subranges, and the 
values Xi, a' 2 , • • • Xn refer to the centers of these subranges, as shown in 
Figs. 1 and 2 for n = 8, then matrices corresponding to the matrix 33 
may be formed for tlie sine and cosine functions. 

Thus it is found that 

(2k - I)ir 

— nr- 



so that if 


aicf — COSSXi 


[52] 
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Fig. 1. Division of sine into sub¬ 
ranges appropriate to the formation 
of an orthogonal matrix. 



Fig. 2 . Division of cosine into sub¬ 
ranges appropriate to the formation 
of an orthogonal matrix. 


and 


then the matrices 


and 




«11 

«21 

OL\2 

«22 

• • • ain 

• • • 02n 


«n2 

* * * 


^12 

■ ■ ■ 01,,' 

021 

022 

■ • • 02n 

Jnl 

0n2 

■ • • 0nn. 


satisfy the conditions 


n 

Z Otkraks 

t=l 


n 




n 


for r = ±s except 


n for r = jr = 0 

[ 0 for r 5 ^ ±5 or r = zb (5 = n) 


n 

^2 


[53] 


[54] 


[55] 


[56] 


and 


± n 
0 


for r = ±5 except 

for r = ± (s = n) 

for r 7 ^ or r = s = 0 


[57] 
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These may be put into a form in which they more nearly simulate the 
expressions 49 and 50 through noting, with reference to Figs. 1 and 2 , that 


Hence 


£ Sx = 


- forr = ±s except 
r for r = 0 

0 forfT^is orr=±(s = «) 


Z) &kT&k, ^ = 

;i-i 


± - for r = ±s except 

zt IT forr = ±(5 == ») 

0 for r ±5 or r = 5 = 0 


These, or the expressions 56 and 57, may be verified independently. 
Thus 

ctkrak» = cos rxjfe cos sxt = ^{cos (r - s)xk + cos (r + s)xij [61] 


PkrSk, = sin rxk sin ix* = ijcos (r - 5 )x* - cos (r + 5 )xfci [62] 
Now by Eq. 51 

^ ^ f(2^ - l)(r- jV] 

2 cos (r - 5 )x* = Z cos --- 

*-i fc-i I 2n J 

(r — s)ir 3(r — 5 )ir ( 2 n — l)(r — jItt ^ 

+ + - Tn - 

This expression is the same as the right-hand side of Eq. 15 of the pre- 
vious article except that—--takes the place of x, and ( 2 « — 1 ) 

takes the place of n. Hence it is found that 

“ , sin (r — j)ir j n iovr = s . ^ 

Z cos (r - s)xk =-^-V = \ ^ , [64] 

*-i ._ (r — 5 )jr 0 iorr^^s except 

In [ —fi forr = — (5 = m) 

Similarly 

i \ sin (r -I- 5 )t / » for r = -^ , , 

Z cos (r + s)xk = -TTXrr ^1 Of ^ [65] 

k~i ^ (r -h 0 iorr^—s except 

2w —M fr>r r = Cc = 


n forr = —s 
0 for r — s except 
—» forr = (5 = «) 
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The last two relations, together with those stated by Eqs. 61 and 62, 
verify the conditions given by Eqs. 56 and 57. 

If the functions aks and are normalized through division by 
y/nl2^ it is observed that they fulfill conditions of the form given by 
Eq. 34 except for r = 5 = n. This means that if the coefficients in the 
partial sum 31 are approximately evaluated by means of the formula 35, 
a correction must be applied for the coefficient an* It should be observed 
in this connection, however, that the values of the coefficients a* obtained 
by such a method become more and more approximate the nearer the 
index k approaches n. As pointed out previously, the partial sum 5n(^) 
converges toward the desired function f{x) only as n is increased without 
limit. For a sufficiently large finite w, the partial sum 5n(x) may be 
regarded as an approximation to f{x) which is close enough for certain 
practical purposes, but the degree of the approximation is then very 
likely little affected if one entirely ignores the last term, or perhaps 
several terms in this vicinity of the partial sum 5n(x). This item is further 
discussed in Art. 15. 

It may also be observed that the matrices 54 and 55, with the elements 
as defined by Eqs. 52 and 53, are actually not orthogonal matrices since 
the orthogonality conditions are fulfilled only for their columns, and not 
for their rows. As far as the present problem is concerned, however, 
this situation is not significant since none of the reasoning given in the 
present article is thereby affected. 

3. The eourier series 

The previous article indicates how a representation in the form of an 
infinite trigonometric series may be found for a given function f{x) 
specified over a finite interval a ^ x ^ a Iv, Incidentally, this desig¬ 
nation for the interval may be regarded as perfectly general inasmuch 
as any other, such as a < x < a + f, is converted to it by means of the 

change of variable x-^~^ 

2ir 

The trigonometric series, or Fourier series, as it is called, has the form 

/(*) = " 5 : + fli cos X cos 2x + az cos 3x + • • ■ 

+ bx sin X + b 2 sin 2x + 63 sin 3a: + • • • 

The necessity of having both sine and cosine terms is readily recognized. 
Writing the series 66 in the more compact form 

/(^) = "TT + L an cos nx + bn sin nx 

n *1 n *1 



[67] 
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multiplying both sides by cos mx, and integrating over the fundamental 
range, one has 


r + 2 ir 

/w 


COS mx dx = 


do 

2 t/tt 


+2» 


COS mx dx 


+ 


22 dn COS nx cos mx dx 

n»l 
na-i-2-r * 

+ / £ sin wx cos wa; d* 

*Ja n **1 


[ 68 ] 


The first integral on the right-hand side is zero except for w = 0. Exclud¬ 
ing this value, and assuming for the moment that the series 66 or 67 
converges uniformly over the fundamental range a ^ x ^ a + 2t, so 
that the integration of the infinite sums may be carried out term by 
term, one finds 


'»a-f 2«’ 


X o+2ir pa 

f (x) cos mxdx = dn I cos nx cos mx dx 

* pa + 2w 

+ / sin nx cos mx dx 

n *=1 c/a 


[69] 


In view of the conditions expressed by Eqs. 46 and 47, one obtains 

1 pa+2r 

= J fix) cos mx dx [70] 


This formula evaluates the coefficients of the cosine series, and inci¬ 
dentally gives the coefficient Uq correctly also, inasmuch as the ortho¬ 
gonality conditions 46 and 47 applied to the term-by-term integration in 
Eq. 68 yields for w = 0 


f{x) dx = y dx = aoTT 


[71] 


If Eq, 67 is multiplied by sin mx and integrated term by term over 
the fundamental range, it being recognized that the term with Uq then 
yields zero even for m = 0, one obtains 


J f'a+2r » pa+2w 

I f(x) sin mxdx = ^ a„ f cos 

+ i:b„ r 

n =1 %/a 


nx sin mx dx 


'»a-|- 2 ir 


sin nx sin mx dx 


[72] 


Here the use of the orthogonality conditions 45 and 46 gives 

I pa-^2r 

bm — I f {x) sin mx dx 

IT %/a 


[73] 
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which is a formula for the coefficients of the sine series in Eq. 66 or 67. 

A convenient form for the formulas 70 and 71 is obtained if the funda¬ 
mental range is specified as -tt ^ x g tt, as can always be accomplished 
by a suitable definition for the independent variable. Then, n being 
written in place of m to provide a more evident consistency with the form 
of the series as stated by Eq. 67, the formulas read’*' 

1 

Gn = / /(^) cos NX dx, for 71 — 0, 1, 2, * • * [74] 


and 


^71 = - f f{x) sin nx dx, for n = 1, 2, 3, 

TT 


[75] 


It is now significant to observe that if the specified function f(x) is 
€ve7i, that is, if 

f{-x)=f{x) [76] 

the integrand in the integral for is an odd function of a*, and the 
integral between the symmetrical limits — tt and tt vanishes. In other 
words, all the coefficients hn are then zero, so that the function fix) is 
represented by a cosine series alone. This should, of course, be expected 
for an even function f(x) since the cosine functions are even and the sine 
functions odd. 

On the other hand if f(x)j with regard to the fundamental range, 
— tt ^ X g TT, is an odd function of Xj that is, if 

f(-x) = -/(x) [77] 

the integrand in the integral for On is an odd function, and this integral 
vanishes for the limits —tt to tt. All the coefficients of the cosine terms 
are then zero, and the function/(.r) is represented by a sine series alone. 

This state of affairs suggests that in general one may write 

fix) = fi(x)+f2ix) [78] 

in which/i(x) is an even function and /^(x) an odd one. That such a 
representation for the function /(x) should always be possible is clear 
from the fact that if x in Eq. 78 is replaced by — x, and the relations 
76 and 77 are observed with regard to the even and odd functions/i(x) 
and/ 2 (x) respectively, there results 

f{-x) =Mx) -f 2 ix) [79] 

*It may not be superfluous to point out that the derivation of these formulas for the 
Fourier coefficients in no way proves that the series can actually be used to represent a periodic 
function. The conditions under which such a representation is possible and a discussion of 
the convergence of the series arc given in Arts. 7, 8, 12, 13, 14. 
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Addition and subtraction of Eqs. 78 and 79 then yield 

/i (^) = i {/(^) + /(} [80] 

and 

= [81] 

Hence the even and odd components/i(a;) and f 2 {x) of an arbitrary 
function f{x) can always be uniquely determined either analytically 
or graphically. 

Substituting the representation 78 for fix) into the integrals of Eqs. 
74 and 75, and taking note of the odd and even character of the functions 
f 2 ix) and fiix) respectively, one finds that 

o„ = ^ y* /i (x) cos nx dx, for » = 0, 1, 2, • • • [82] 


and 

1 

f>n — - I f-zi^) sin nx dx, for « = 1, 2, 3, • • • [83] 

TT t/—ir 

In other words, the coefficients of the cosine terms in the series 66 are 
determined from the even component of fix) alone, and the coefficients 
of the sine terms are determined from the odd component alone. Inas¬ 
much as an arbitrary function fix) must in general contain both even 
and odd components according to the decomposition expressed by Eq. 
78, it follows that the trigonometric series representing/(x) must contain 
both sine and cosine terms. When it is assumed, then, that the even and 
odd functions respectively are completely represented by cosine and sine 
series, it follows that the fonn of the assumed series representation for 
fix) as given by Eq. 66 is also sufficient. This question, as well as the 
manner in which the trigonometric series approximates the function /(x) 
as the number of terms in its partial sum is increased, is discussed in the 
subsequent articles. 

In the meantime it may be useful to observ'e that the integrands in 
both the integrals 82 and 83 are even functions of x. Consequently the 
same value is obtained if the integration is extended only over the range 
zero to x and the result is multiplied by two. This gives the alternative 
formulas 

2 C” 

= “ I fii^) COS nx dx, for » = 0, 1, 2, • • • [84] 

x«/o 

and 

— ~ /zC*) sin nx dx, for n = 1, 2, 3, • • • 


[85] 
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In the discussion so far, it has been assumed that the function/(ic) is 
defined only within the interval a ^ x g a + 27r, that is, that the 
function does not necessarily exist also for values of x not in the stated 
ranjxe. For example, if J{x) represents the initial distribution of voltage 
on a transmission line and the interval a ^ x ^ a lir corresponds, by 
reason of a suitable change of variable, to the length of that line, it is 
manifestly clear that an incjuiry regarding the values of this function 
beyond the limits of its fundamental range has no sense. From a practical 
point of view such an inquiry does not arise since one is content with a 
solution valid over the extent of the physical system. 

It is, on the other hand, sensible to inquire, for the moment out of 
pure curiosity perhaps, what kind of function the trigonometric series 
represents when all restrictions on the independent variable are removed, 
in other words, if x is allowed to take on all values from — co to • In 
view of the periodic character of the trigonometric functions, the answer 
to this question is obvious. The trigonometric series represents a periodic 
function with the period Itt, such that the behav^ior of the function 
throughout any one period matches that of the function fix) over its 
fundamental range. 

It is thus clear that the trigonometric scries in Eq. 66 is capable of 
representing an arbitrary periodic function over the entire range of its 
independent variable from minus to plus infinity. Such functions occur 
quite frequently in engineering analysis, the independent variable 
usually being the time t. The periodicity of the function is expressed by 
the relation 

/(/ + ^t)=/(/) [86] 

in which r is the period (sometimes referred to as the f undamental period ) 
and k is any positive or negative integer. The reciprocal of r is the 
fundamental frequency 

/=; OT 

and 

„ = 2t/ = — [88] 

T 

is the fundamental angular frequency or radian frequency. 

The Fourier series representation for the periodic function /(/) is 
written 


/(/) = y + ai cos + 02 cos 2a)^ + • • • 
-h hi sin 0)1 -f- sin 2co/ “h • • * 
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in which, according to Eqs. 74 and 75, 

cin = " / /(O COS nuildt, for n == 0, 1, 2, 

TT t/— X /«*) 


and 


CJ 

= / /(/) sin nwt dly for w = 1, 2, 3, 

TT ^—JT / 


[90] 


[91] 


4. Thk phase angles of the lEVRMONic compont;nts 
In view of the trigonometric identities 

Cn COS (wa)^ -|~ 0n) ^ sin 2 ^ 

^ Cr^ cos <^n COS wo)/ — sin sin no}i [92] 
it is possible to combine the sine and cosine series in Eqs. 66 or 89 through 


letting 

Cji — Cn cos (f)n 

[93] 


hr, = — sin (t)j^ 

whence 


Cn — + bn^ 

[94] 


The Fourier series can then lie written as a sum of sine or cosine terms 
alone, for example, as 

/(O ~ “f* cos (co^ + <t>i ) -f* C 2 cos (2(*}t + <^ 2 ) + • • • [95] 


The term having tlie fundamental angular frequency is commonly 
called the fnjidamcntal (07n[>onent of the periodic function /(7), and the 
remaining terms, whose frequencies are integer multiples of the funda¬ 
mental, are referred to as Jiarmofiics. The coefi'icients Cn and the angles </»n, 
which are determined by Ecjs. 94 together with Eqs, 90 and 91, are known 
as the harmonic afnplitndcs and phase angles. 

Because of the {leriodic nature of the function/{/) it is usually possible 
to select the origin for the inde]>endent variable t at any convenient point. 
In subsequent manipulations it may, nevertheless, be desirable to shift 
the origin to a new location. Thus, if the variable / in/(/) is replaced by 
(I h)i the elTed is to shift the origin back by an amount equal to (q 
(this shift amounts to retarding the sequence of values of the function 
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by ^o)- Graphically, this change of variable corresponds to shifting the plot 
of the function forward by an amount Iq. A typical harmonic component 
becomes 

Cn cos inwii — /o) + <t>n] = Cn COS [uat + (^„ — nco/o)] [96] 

This result may evidently be interpreted as a change in the harmonic 
phase angle to the new value 

- * 2rntn rAtai 

4> n — 4>n ~ = 4>n - [97] 

T 

It is significant to note here that each harmonic phase angle is changed 
by an increment proportional to the order n of the corresponding har¬ 
monic component. Such a proportionate change in the harmonic phase 
angles, therefore, leaves the resultant form of the function /(/) unchanged 
except for a translation of the function as a whole. 


5. Even and odd harmonics 

It frequently occurs that the given perodic function satisfies the 
condition 

/((± !)=-/«) P8] 

which means that the sequence of values of the function throughout 
any half period are the negatives of the values encountered throughout 
the preceding or succeeding half period. In order to observe the effect of 
this condition upon the form of the resulting Fourier series, one may write 
the expressions 90 and 91 for the coefficients in the form 

Un = ^ j[* |/(0 cos mat +f^t cos no)(^t - 0 j dl [99] 

and 

6n = - |/(0 sin fleet + / 0 sin nee dt [100] 


These are readily recognized as being equivalent to Eqs. 90 and 91 
through noting, for example, that 


^ /(O cos neetdt = ~ ^^COSWOJ^^ — ^ [^01] 


because the second integral is obtained from the first when one makes the 
substitution — t/ 2 and appropriately changes the limits of integra- 
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tion. Then, observing that nwr/l = «x, and hence that 
cos ~ 

sin Mw I« — - I = cos nv sin ruat 




[ 102 ] 


one finds that the condition 98 substituted into P2qs. 99 and 100 is seen 


to yield 





a„ = - (1 — cos njr) 

XT « 

^JT ,'u> 

/ /(/) COS ruat dt 

Jo 

[103] 

and 





An = - (1 — COS nir) 

TT • 

luf 

1 f (1) sin ncot dt 

Jo 

[104] 


The factor (1 — cos mr) is zero for all even integers of n and equal to 
2 for all odd integer values of n. Hence it is clear that when the periodic 
function has the property exj)ressed by Eq. 98, its Fourier series contains 
odd harmonics only. The average value or constant component 2 is 
e\'idently zero also. The coefficients of the odd harmonics are then given 
by 


2a) 

On = — 

TT « 

f(t) COS «cj/ (U 

[105] 

2uJ 

p-lT }u> 

[106] 

bn = 

TT t 

1 f (1) sin ftujl dt 

Jo 


These considerations may suggest the question of what the results are 
when the function /(/) satisfies a relation complementary to that ex¬ 
pressed l)y -h^q. 98, naniel}', when 

/^/±0=+/(O [107] 


Althougli recognizing that the factor (1 — cos nr) in Kqs. 103 and 104 is 
changed to (1 + cos ht) gives the answer a moment’s reflection reveals 
that the condition 107 merely states that /(/) has the period r/2 instead 
of T. If r is retained as the fundamental period, the result is that the 
Fourier series contains only even harmonics, which is just another way 
of saying that the period of /(/) is actually half as large. 

On the basis of these thoughts it appears that any periodic function 
may be assumed to consist of two components, of which one satisfies the 
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condition 98 and the other has twice the fundamental frequency. This 
decomposition may be indicated by 


in which 

/(0 = 

/i(0 +M(0 

[108] 


11 

41 

^ 

< 

[109] 

and 





/n ± 2^) 

[110] 

It then follows that 


) = fi(0 -M(0 

[111] 

and hence, adding and subtracting Eqs. 108 and 111, that 


MO = ^ 


[112] 


/u(0 = 2 ' 

[/(()-/((±0j 

[113] 


This decomposition is similar in analytic form to the decomposition 
into even and odd components as stated by Eqs. 80 and 81, but should 

not be confused with the latter. The 
decomposition into even and odd 
components according to Eqs. 80 and 
81 is a decomposition of the given 
/ i function into components which 

are respectively symmetrical and 
antisymmetrical about the ordinates 
at X = 0 or / == 0, and hence yields 
a decomposition of the Fourier series 
into its component cosine and sine 
series, each of which in general con¬ 
tains both even and odd harmonics, 
and hence can be further decomposed according to the relations 112 and 
113. 



Fig. 3. Decomposition of a saw-tooth 
wave into even and odd harmonics 


The component functions given by Eqs. 112 and 113, on the other 
hand, may individually be either even or odd but in general are neither, 
and hence can also be further decomposed. The decomposition indicated 
by Eq. 108 is such that the first component contributes the even har- 
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monk components to the resulting Fourier series, and the second con¬ 
tributes only the odd harmonics. An interesting example of this decom¬ 
position is illustrated for the saw-tooth wave shown in part (a) of Fig. 3. 
Here the rectangular wave (shown dotted) represents the odd harmonic 
components, and the even harmonics are due to the saw-tooth wave of 
double frequency, part (b), which remains after the rectangular com¬ 
ponent is subtracted from the original saw-tooth wave. 

6. Alternative Fourier expansions for a function defined 

OVER a finite range 

The preceding articles show that there is an iniinite variety of ways to 
establish a Fourier series representation for a function which is defined 
over a finite region, if the sole object is to obtain a trigonometric series 
which yields the correct values of the stated function over this finite 
range only. One way is to consider the defining range of the given function 
as the fundamental period, as is done in Art. 3. However, since this range 
may alternatively be considered as only a part of the fundamental 
period, and since the definition of the given function over the remainder 
of this period as well as the extent of the period are entirely arbitrary, 
it is clear that any number of trigonometric series representations may be 
found. All of them yield the same values over that portion of the period 
which corresponds to the original defining range, although they may show 
a variety of behaviors throughout the remainder of each period. 

It should be observed that if the determination of a Fourier expansion 
appears as part of the process of solving a boundary value problem, such 
a variety of alternative possible procedures does 
not exist, because the conditions of the problem 
permit the choice of only one set of proper 
functions in terms of which the expansion may 
be made. There are, however, many other ways 
in which Fourier expansions enter into engi¬ 
neering analysis, and in most of them the ob¬ 
ject of using the series representation is solely 
to get an approximating function in the form of a 
trigonometric series for some given function whose behavior is specified 
over a finite interv’al. Inasmuch as the engineer must, for practical 
reasons, limit the expansion to a finite number of terms, and the computa¬ 
tional labor as well as other economic factors dictates that this finite 
number shall be as small as possible, the freedom of choice mentioned 
in the preceding paragraph must be recognized as an important con¬ 
sideration in the selection of a suitable process of analysis. 

As a simple illustration of how a variety of series representations may 



Fig. 4. A function de¬ 
fined over a limited range. 
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be obtained for a given function defined over a finite range, it is interest¬ 
ing to consider the function illustrated in Fig. 4 for which the defining 
range is the region 0 ^ x ^ arj. Parts (a) to (e) of Fig. 5 show several 



odd harmonics only 
(0 



odd harmonics only 
(d) 



good approximation with a 
single sine term 

(e) 


Fig. 5. Various possible periodic continuations of the function of Fig. 4. 

ways in which this function may be assumed to be continued beyond the 
defining range so as to yield a periodic function. In each case the behavior 
over the defining range is the same as that given in Fig. 4, but the series 
representations for the individual cases are nevertheless quite different, 
as indicated on each sketch. 
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It is also significant that the rate of convergence of the resulting Fourier 
series may be quite different for the different forms of periodic functions. 
As is also pointed out in a subsequent article, the convergence is in general 
more rapid for a smooth function than it is for one which varies er¬ 
ratically or has large first or higher derivatives. For example, the series 
for a function which has discontinuities, like those sketched in parts 
(a) to (c) of Fig. 5, in general converges rather slowly, so that a large 
number of terms must be calculated in order to establish a fairly good 
representation for the function. If the latter is continuous, as it is in 
parts (d) and (e) of the figure, the convergence is considerably more 
rapid. The function shown in part (e) has a more rapidly converging 
series than the function in part (d) w'hose first derivative has discon¬ 
tinuities. In fact, the function in part (e) is approximated very well by a 
single sine term. 


7. The Fourier series as a special form of the Laurent 
expansion; the complex Fourier series 

The Fourier series may alternatively be obtained from the Laurent 
expansion discussed in Art. 12 of Ch. VL According to Eqs. 163 and 166 
of that chapter, the expansion has the form 


/(z) = Z an(z - So)” 


[114] 



in which the coefficients are given by the 
formula 

” 2<r;X (f - z„)"+' *■ 

The region of uniform convergence lies 
between the circles rj and r 2 indicated in 
Fig. 6, for which it is assumed that ri < 1 
< r 2 . The expansion 114 then converges 
uniformly for all points on the unit circle 
drawn with Zo as a center. As discussed in 
the previous chapter, this statement as¬ 
sumes, of course, that the function is reg¬ 
ular and continuous at all points within the annular region enclosed 
by the circles with radii ri and r 2 - No restriction is implied by the 
assumption that ri < 1 < r 2 , since this condition may in any case be 
obtained by means of an obvious change of variable, should it not be met 
in the first place. 


Fig. 6. Region of uniform 
convergence of a Laurent series 
from which the Fourier series 
may be obtained by an appro¬ 
priate change of variable. 
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If the point z in the expansion 114 is assumed to refer to any point on 
tlie unit circle, and the latter is also chosen as the path of integration S 
in the formula 115, one may write 

z-Zo = ef * [116] 

and 

f - zo = e ’'^ [117] 

whence 




r - So 


= j 


[118] 


The expansion 114 then takes the form 

/(s) = i [119] 

n — — « 

in which, according to Eqs. 115, 117, and 118, 

1 r''+^-f{yp)j 1 riom 


Since the point z is restricted to lie on a circle about zo, f(z) evidently 
reduces to a function of the real variable 0, In order to conform with 
more familiar conventions, the symbol <t> may be rej)laced by x and the 
v^ariable of integration ^ by so that Eqs. 119 and 120 take the fonn 

fix) = i [121] 

and 

[ 122 ] 


Although the function f{x) is real, it should be observed (hat the 
coefiicients an are complex. The series representation for the function 
f(x)y as expressed by Eq. 121, is known as the complex Fourier scries. 
It may readily be shown to be entirely equivalent to the real form in 
terms of sines and cosines. The first step in this regard is the observ ation 
that, according to Eq. 122, the coefficient an is replaced by its conjugate 
value if n is replaced by that is, 

This result is clear from the fact that changing the sign of n in Eq. 158 
is equivalent to changing the sign of j. The scries 121 may be written 



Art, 7] 


THE COMPLEX FOURIER SERIES 


461 


out in the form 

/(*) ao + ^ _,. ^_^e-j 2 x ^ a_3g->3x ^ . . . [124] 

from which it is seen that the terms appear in pairs of conjugates. A 
typical conjugate pair reads 

[125] 

[126] 

[127] 


Now if one writes 


Ctrl j^n 

OCn — -- 


then, according to Eq. 123, 


^ n jl>n 


The pair of terms given in Eq. 125 then becomes 

= dn COS HX + bn SUl ttX [128] 

whereas the separation of Eq. 122 into its real and imaginary parts yields 


and 


1 na-^2r 

= / fii) COS 

TT «/ . i 




1 pa + 2ir 

K = - / /(O sin wf 

TT t/a 


[129] 


[130] 


^0 

Since = 0, and hence ao = - , Eq. 128 shows that the series 124 is 
equivalent to 

f{^) = y + cos X + a 2 cos 2x + • • • 

+ sin X + &2 sin 2a: + • • • [131] 

which is the familiar form for the Fourier series in terms of its sine and 
cosine components. The formulas 129 and 130 are seen to be identical 
with those given by Eqs. 70 and 73. The equivalence between the com¬ 
plex form 121 and the ordinary form for the Fourier series is thus estab¬ 
lished, and the formula 115 for the coefficients of the Laurent expansion 
is seen to contain the formulas for the Fourier coefficients as a special case. 

The complex form for the Fourier series is more convenient than the 
ordinary form for many manipulations because of its relative compact¬ 
ness as contrasted with the sine and cosine form, and also because of the 



462 


FOURIER SERIES AND INTEGRALS 


ICh, VII 


greater ease with which the exponential function may be manipulated 
with regard to various algebraic as well as differential and integral oper¬ 
ations. In this connection it may be observ^ed, incidentally, that the 
complex form requires only the one formula 122 for the evaluation of 
its coefficients as contrasted to the two formulas, 129 and 130, which are 
ordinarily needed. 

The relation between the complex coefficient and the real coefficients 
an and bn is further illustrated by the sketch in Fig. 7 which shows a 

pair of conjugate complex coefficients 
an and a_n* These may be regarded 
as the conjugate complex terms 
anC^^^ and for a: = 0. As the 

variable x increases from the value 
zero, the vectors which these terms 
represent rotate in opposite directions 
at an angular rate of n radians per 
unit of X. They, therefore, remain 
conjugates for all values of x, so that 
their vector sum becomes a real, 
simple harmonic function of x. For 
X ^ Oil this pair of conjugate terms 
is thus seen to represent a simple har¬ 
monic function of the time t with an angular frequency of nm radians 
per second. 

Denoting the angle of the complex coefficient by as indicated 
in Fig. 7, that is, writing 

= \oCn\ a^n = l<^n| [132] 

one finds that the expression for this simple harmonic function is given by 

= 2\an\ cos {nx + 4>n) 

Equations 126 and 132 give 

Q'n —jbn = 2|an| COS <t>n +i2lan| sin <f>n 
or separating reals and imaginaries this yields 

an == 2|an| cos (l>n 
bn = -“2|an| sin 4>n 

Comparison with Eqs. 93 and 95, shows that the resulting harmonic 
amplitude Cn is equal to twice the magnitude of the complex Fourier 
coefficient an, whereas the harmonic phase angle is the angle <t>n of the 


[133] 

[134] 

[135] 



Fig. 7. A pair of conjugate complex 
coefficients of the complex Fourier 
series. 
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complex coefficient an* These results are also evident from inspection 
of Fig. 7. 

The complex form for the Fourier series is thus seen to contain the 
phase angles of its various harmonic components by virtue of the complex 
character of the complex coefficients. The formula 122 for these coeffi¬ 
cients yields these harmonic phase angles as well as the corresponding 
amplitudes 2|an|, and the complex form of the series, as expressed by 
Eq. 121, contains both the amplitudes and the phase angles although the 
latter do not appear explicitly. This fact, namely that the harmonic 
phase angles are implicitly contained in the complex form 121, and hence 
need not be explicitly written dowm during any manipulations which 
may be carried out with the series, is one of its greatest labor-saving 
virtues when the Fourier series is used in various analytic formulations. 
This advantage becomes particularly apparent from the discussions given 
in Art. 9. 

Inasmuch as the basis for the Laurent expansion requires that the 
function f{z) be regular and continuous throughout the annular region 
enclosed by the circle with radii ri and r 2 in Fig. 6, one should expect 
that the validity of the Fourier series would be similarly restricted. 
Although this restriction, in general, holds if one expects uniform con¬ 
vergence of the series for all values of its independent variable, it is found 
nevertheless that the conditions for the possibility of obtaining a Fourier 
series representation for a given function are somewhat less confining if 
certain reserv^ations are accepted regarding the convergence of the result¬ 
ing series. 

The conditions, knowm as the Dirichlct conditions, under which a 
Fourier series representation for a given function is possible, state that 
throughout the fundamental range for which the function is defined, it 
shall possess a finite number of maxima and minima, and in spite of having 
a finite number of discontinuities and points where the function becomes 
infinite, it shall possess an absolutely convergent integral; that is,* 

jT \fix)\dx [136] 

shall be finite. If, according to the latter part of this statement, the func¬ 
tion becomes infinite at some point, this infinity shall be integrable, for 
e.xample, like a logarithmic infinity. (It should be recalled that the area 

‘The absolute convergence is required only if the integral ^ /(.r) dx becomes improper. 

Actually, the conditions set down by Dirichlet are more stringent than those just stated, and 
flo not permit the function fix) to become unbounded. The conditions stated here arc, never¬ 
theless, de.«ignated by many writers as the Dirichlet conditions, and inasmuch as it is a con¬ 
venient way of referring to them, this somewhat inaccurate practice is used here also. 
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under a logarithmic infinity is finite.) The series converges uniformly for 
all values of the independent variable except those corresponding to 
points of discontinuity, and at the points corresponding to infinite values 
for the function the series can, of course, no longer converge. 

At a point of discontinuity, which may be denoted hy x ^ Xiy the 
Fourier series yields the average of the two values of the function imme¬ 
diately adjacent to this discontinuity, that is, the series yields the value 

f(xi — 0 ) + f(xi + 0 ) [ 137 ] 

The reason for this property of the series is discussed in Arts. 12 and 13. 
Together with a number of other interesting items, it is illustrated by 
some of the examples of the next article. 


Fig. 8. 



The saw-tooth wave is basic in the description of discontinuities. 


8. Several illustrative examples; a criterion regarding 

THE RATE OF CONVERGENCE 

The first example to be considered is shown in Fig. 8. This function 
h{x) has discontinuities of unit magnitude which occur at the origin and 
at integer multiples of Iw. It is similar to the saw-tooth wave shown in 
Fig. 3 except that it is turned over and raised so as to lie upon the jc-axis. 
This function may be defined by the statements 

---— for -TT Cc < 0 

2 ZTT 

[138] 

Hx) = T -I- x — for 0 <x <ir 

It is observed, therefore, that except for the constant component the 
function is odd. Hence its Fourier series is given by Yz plus a sine series 
whose coefficients are evaluated by the formula 85. These coefficients are, 
therefore, given by 

1 

— '-h ! — x) sin nx dx 

IT «/o 


[ 139 ] 
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The integration yields 


so that the resulting Fourier series becomes 

1 ,1 fsin * sin 2* sin 3x T 

*w = 2 + ;L—+ — + — + •■•] 

At the points x = 0, 2 t, 4x, • • • —2x, —• • • etc., the value of the 
series is ]/% which is the arithmetic mean between the values of A(x) 
immediately adjacent to these points of discontinuity as stated by the 
expression 137. For the immediate vicinity of these points the series 
cannot be said to converge uniformly because it yields different values, 
depending upon the direction from which these points are approached, 
and hence the partial sums do not converge toward a definite limit in this 
vicinity as n is indefinitely increased. 

In order to investigate the convergence for other values of * one may 
regard the partial sum 


. . I fsin 

’■(*) - ;Lt 


* sin 2x 
- + —+ 


sin nx " 


and form 

— 1 sin (n + l)x 
""it n + 1 


sin (w + 2)x 
+■ 


sin (n + k)x\ 


n + k 


Letting 


(Tn = sin a: + sin 2x + • • • + sin nx 


one may write the expression 143 

IwW - ^n(a:)| 

_ 1^ <^n4-l I <^714-2 

T W -[“ 1 w -j- 2 


+ • • • + [145] 

n + k 


The right-hand side of this equation may be written alternatively in the 
form 

i bTT C + 1 ~ » + 2) (» + 2 ~ n + s) ■*" " 

+ („ + - iTTi) + f+iI 
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Now, according to Eq. 12, 




X X 

cos - - cos (2« + 1)2 


« . * 
2sin- 


[147] 


Although, for various values of n and x, this sum an niay have a variety 
of positive or negative values (in particular for x = 0 or a multiple of v 
it has the value zero), it is clear that a finite positive quantity S may be 
found which the absolute value of cr„ cannot exceed for any x and any », 
no matter how large the value of the latter may be chosen. In other 
words, it is possible to specify that 

\an\ < S for any x or n values [148] 


in which S is finite. 

Observing that the coefficients of the partial sums an^\y o’n+ 2 ) * • • 
in the expression 146 are positive, and that an may have a numerically 
negative value while the remaining partial sums are at the same time all 
positive, one sees that, even in these most unfavorable circumstances, this 
expression nevertheless cannot have a value in excess of 


s 

^ 1 ^ * 1 ’ ‘1 

1 1 

- J _ 

2S 

TT 

w+1 ‘ «+l n-t2 ' n+2 n+3 ' 

n-{-k * n + k 

ir(n+l) 


[149] 


Hence it is established that 




2S 

^ Tr{n + 1) 


for all n and k 


[150] 


Consequently the statement that 

< € independently of a; 


[151] 


for all values of k and all values n > N may be justified through choosing 


or 


which means 


2S 

Tc{n + 1) * 

[152] 

2S 

(«+!)>- 

7r6 

[153] 

iV = “-l 
ir€ 

[154] 


According to Cauchy^s principle of convergence (Eq. 94, Art. 9, Ch. VI), 
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therefore, the Fourier series 141 for the function illustrated in Fig. 8 is 
seen to converge uniformly over any range of :r-values which excludes 
the points of discontinuity. 

The results obtained for this simple example enable one to draw 
conclusions regarding the convergence of Fourier series for more arbitrary 
functions possessing a finite number of discontinuities. As a first step 
toward evolving such a generalization, a function j{%) may be assumed 
to have a single discontinuity equal to the value 6 at some point x = 
in the fundamental range a ^ x ^ a + 2t. In other words, the function 
f{x) is continuous throughout this range except for a sudden jump 8 
(positive or negative) in its value at the one point x = 

In terms of the function h(x) of Fig. 8, one may form a function 
8 • h(x ~ Xy) which is a saw-tooth wave having a jump equal to 5 at the 
point X = Xy in the fundamental range. If this function is subtracted 
from/(jc), the resulting function 

F{x) = f{x) — 8h{x — Xy) [155] 

must be continuous throughout the fundamental range a ^ x ^ a + Itt. 

With this result tucked away in one’s mind for future reference, at¬ 
tention is for the moment tunied toward the formula 122 for the complex 
Fourier coefficients, wliich is repeated here for the convenience of the 
reader 

an = ^jf [156] 


Here one may apply the principle of integration by parts, for which the 
well-known formula reads 


Letting 


one has 



u = /(O and 
du — di and 


dv = df 






jn 


[157] 

[158] 

[159] 


in which the superscript (1) on the function /(O indicates that its first 
derivative is meant. Subsequently, the supcrscrijits (2), (3), etc., are 
used to denote the second and higher order derivatives. 

Substitution into the formula 157 yields for the coefficient a„ of Eq. 156 


2Trnj 2TmJ Ja 


[ 160 ] 
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However, 




Imj 


}ni-la+2w 

i _ <* 


2irnj 


, {f{a + 2 t) -f{a)\ = 0 


[ 161 ] 


By repeatedly applying the same process, one may obtain the formula 


which, of course, is a proper integral only so long as the feth derivative 
(() remains finite, although it may be discontinuous. 

It may now be supposed that the given function /(x) and all its suc¬ 
cessive derivatives f^^Hx), are continuous, but 

that the /feth derivative (x) possesses the discontinuity 5 at x = x,. 
Then, according to the argument leading to Eq. 155, the function 

(x) = (x) - « • A(x - X,) [163] 


is still continuous, and hence for it the procedure leading to the integral 
162 can be continued at least one step further. Hence the Fourier co¬ 
efficients a„ for the function F^*^(x) must decrease in magnitude for 
large values of n at least as rapidly as the ratio 1/ Inasmuch as the 

illustrative example at the beginning of this article shows, however, that 
the Fourier coefficients for the function h{x — x„) decrease with in¬ 
creasingly large n only as fast as the ratio 1/n, it follows that those for 
the function (x) can do no better although they are certain to do as 
well. These coefficients are given by 

1 /•o+2» 


and hence the coefficients for the function/(x) are, according to Eq. 162, 
expressible as 


On = 



[165] 


One may, therefore, conclude that for a function /(x) which, together 
with all its successive derivatives up to that of the ith order, is continuous 
throughout the fundamental range, and for which, therefore, the ^th 
derivative is the first one possessing a discontinuity within this range, 
the Fourier coefficients are found to decrease in magnitude for large 
values of n as rapidly as the ratio l/»*'^^ 

Furthermore, one may conclude that, inasmuch as the Fourier series 
for h(x — x,) converges uniformly over any region whose boundaries 
exclude the points x, ± an integer number of 2t’s, the series for the 
function (x) also converges uniformly over the same ranges. In the 
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immediate vicinity of a point of discontinuity this series no longer con¬ 
verges uniformly, but its partial sums (x) in absolute value evidently 
remain smaller than some finite upper bound like the value S for the 
partial sum 144 or its closed form 147. Recognizing that the Fourier 
coefficients for the function (x) are those for the function {x) 
multiplied by !/;», and following a procedure identical to that used in 
the investigation of the convergence of h{x), one is led to the conclusion 
that the series for/*”'*^(x) converges uniformly even over a range which 
includes the discontinuity of The series for the derivatives of 

lower order, and so on down to that for the function/(x), then certainly 
do likewise. 

An important result of this line of thought is the fact that if a given 
function f{x) is itself continuous but possesses a discontinuity in its first 
derivative at some px)int Xy, the Fourier series for f{x) still converges 
uniformly at the point x = Xy. It may, therefore, unquestionably be 
integrated term by term, and it may also be differentiated term by term, 
although the point of discontinuity Xy must then be excluded from the 
region of uniform convergence. 

Each time the Fourier series is integrated term by term, an additional 
factor n is introduced into the denominator of the expression for an, 
and each time it is differentiated, a factor of n is canceled out of the 
denominator of this expression. It is readily seen, therefore, that integra¬ 
tion improves the rate of convergence of the Fourier series, whereas 
differentiation makes the series converge more slowly. This fact may have 
been expected in the first place since integrating a function makes it 
smoother whereas differentiating it accentuates any existing irregularities. 

It is a simple matter to extend these conclusions to include functions 
having a larger number of discontinuities, as long as this number remains 
finite. For example, if the function f(x) has the discontinuities 6i, S 2 , 

• • • at the points Xi, X 2 , • • • Xy within the fundamental range, the func¬ 
tion 

F(x) =/(x) -isMx-Xi) [166] 

i-1 

is continuous throughout this range, whereas the Fourier series for that 
part of /(x) represented by 

i SMx - X,) [167] 

is given by the sum of v series, each of which has the same general form 
as that for A(x). The Fourier series for/(x), therefore, converges uniformly 
over ranges whose boundaries exclude the finite number of discontinuities, 
and the coefficients decrease in magnitude with large values of n as fast 
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as and no faster than the ratio 1/w. The series may be integrated term 
by term, yielding a series which converges uniformly throughout the 
fundamental range, but it cannot be differentiated term by term since 
the resulting series then no longer converges at all. 
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Fig. 9. Two saw-tooth waves add up to yield a square wave. 


The second example to be considered is the rectangular wave with 
identical positive and negative half cycles of unit magnitude as shown 
in Fig. 9. This function has a discontinuity equal to 2 at the beginning of 
its fundamental range 0 g ^ 2 t, and another equal to —2 at the 
center of this range. The saw-tooth functions representing these two 
discontinuities are, therefore, given by 

2h{x) and —2h{x — t) [168] 


After subtracting these from the given function in this example, one 
finds that there is nothing left, that is, 

fix) ~ 2h{x) + 2h{x - x) = 0 [169] 


Hence, according to Eq. 141, the Fourier series is given by 


2rsin 

f{x) =-- 

XL 1 


X ^ sin 2x 

I-h 


] 


2 fsin (x — ir) _ sin 2{x — ir) ^ 

_ . 


■] 


[170] 


With 

sin «(a; — it) = ( — 1)" sin nx 


[171] 


this result yields for the Fourier series of the square wave shown in 
Fig. 9 




4 fsin * . sin 3* sin 5* 


L 1 ^ 3 


+ 


+ 




[172] 


As one should expect from the fact that f{x) is odd, the representation 
given by a sine series alone, and since the function satisfies the condi- 
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tion 98, only the odd harmonics are present. When the origin is shifted to 
the point * = a-/2, the function becomes an even one and the series is 
converted into a cosine series. This shift is accomplished by replacing 
X in Eq. 172 by x + x/2 , thus 

ir\ 4rcosx cos 3a: cos Sa: 1 

d-rh -+ -J t'”’ 

in which it is to be observed that the algebraic signs alternate. It may 
also be noted from Eq. 172 that, at the points of discontinuity of the 
function, the series yields the value zero which again is the algebraic mean 
between the immediately adjacent values of f{x). 




Fig. 10. A triangular wave which results when the rectangular wave of Fig. 9 is 

integrated. 

Integrating the series 172 term by term, one obtains the Fourier series 
representation for the triangular w^ave shown in Fig. 10 which is recog¬ 
nized as the result of integrating the square wave of Fig. 9. Thus, for 
the function of Fig. 10, 

. 4rcos:r cos, cos5 a; , 1 

A fKiint which may be a bit puzzling here is the fact that no constant 
term appears in the expression 174, whereas if one mentally visualizes 
the function which represents the area under the square wave of Fig. 9, 
starting the integration at x = 0, this function evidently turns out to be 
a triangular wave lying u}x>n the a>axis, that is, having the fonn of the 
wave shown in Fig. 10 but with an additive constant component equal 
to 7r/2. 'Fhe reason that this constant component is missing from the 
representation 174 is, of course, the fact that this result is the indefiniie 
integral of the series 172 and not the integral from zero to some variable 
IKiint X. Incidentally, the definite integral from t/2 to any variable 
{xiint .r has no constant compe^nent, as is readily recognized from inspec¬ 
tion of the Fig. 9. At all events one must recognize that the indefinite 
integral can yield only what is customarily referred to as the alternating 
component of the resulting function, and this in the present example is 
the triangular wave of Fig. 10. 
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It should be particularly noted that the series 174 converges consider¬ 
ably more rapidly than the series 172 or 173. Thus the coefficients in 
the series 174 vary as l/n^ whereas those in the series 172 vary only 
as 1/n. This observation agrees with what should be expected from the 
preceding discussion inasmuch as the triangular-wave function is con¬ 
tinuous whereas its first derivative, the square-wave function, possesses 
discontinuities. 

9. The Fotoier spectrum 

The interpretations given in the present article are most commonly 
used in connection with functions which are periodic with respect to 
the time t. The essential manipulations are, moreover, most effectively 
carried out in terms of the complex form of the Fourier series, which is 
expressed by Eq. 121 together with the formula 122. For * = w/ these 
expressions are usually written 

/(/) = i 

n — • 

with 

«„=f [176] 

ztt —«■/« 

Here it is useful to regard the general coefficient a„ as a function of 
the variable nw, which is the angular frequency of the harmonic com¬ 
ponent of order n. Since n assumes only integer values, the variable «w 
is a discontinuous one, and the function ct„, which may alternatively be 
denoted as «(««), has values only for discrete values of its independent 
variable. Nevertheless, it is useful to regard a{nu) as a function rather 
than merely as denoting the values of the Fourier coefficients, since this 
view leads to an interesting and useful interpretation of the relations 
175 and 176. 

The variable t is regarded as the independent variable in a certain 
region designated as the lime domain, whereas the variable n<o represents 
an independent variable in a corresponding region known as the frequency 
domain. The function which is given as f {t) represents a specification of 
some desired function in the time domain, and the corresponding func¬ 
tion a(M«), or found from the integral Eq. 176, is regarded as the 
specification of that same function in the frequency domain. In other 
words, the function a(nu>) is in every respect just as complete and specific 
a representation of the desired function as is f{l), the only difference 
being that a(n<>)) represents that function in a different domain, namely 
that domain in which nu instead of t is the independent variable. 


[175] 
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This view that the function a{nu>) is entirely and uniquely the equiva¬ 
lent of the function f{t) is indisputably tenable since the relation 175 
uniquely converts the function a{nu>) into the function/(/), whereas the 
relation 176 does the reverse. In other words, these two expressions are 
a pair ol mutually inverse relations in the sense that one of them undoes 
what the other does. This circumstance may be placed even more clearly 
in evidence through substituting the expression 176 for «„ into 175, 
which operation incidentally requires writing for the variable of integra¬ 
tion t in Eq. 176 some other symbol u so as to avoid confusion with the 
independent variable t in the expression 175, thus 

/(0= i: f [177] 

By means of this expression, in which the variables t and u both refer 
to the time domain, the given function/(/) is expressed in terms of itself. 

The pair of relations 175 and 176 may, in the light of this interpreta¬ 
tion, be regarded as transformations which accompany the change of 
variable from / to no? or vice versa. For this reason the function a(na)) is 
sometimes spoken of as the Fourier transform of/(/), and the latter as the 
inverse transform of a(«a)). In their present form the transformations 175 
and 176 are restricted by the condition that the function/(/) must be a 
periodic function defined over the entire time domain — oo < t < ». 
The removal of this restriction and the accompanying modification in the 
Fourier transforms are discussed in Art. 19. 

Just as the function /(/) may be represented graphically by being 
plotted in the time domain, so the equivalent function a(ncjj) may be 
plotted in the frequency domain. The latter domain is more commonly 
known as the frequency spectrum and the plot of a (mo) as the spectrum 
representation of the function /(/). 

Inasmuch as the function a(«co) is in general complex, it is necessary 
to make two plots in order to represent it completely. The ones usually 
chosen are the magnitude \an\ and the angle <f>ny although the real and 
imaginary parts could also be chosen. Plots of \an\ and are called 
respectively the amplitude and phase spectra of the given function/(/). 
Since noj assumes only discrete values, these plots are not in the form of 
continuous curvx^s but consist merely of a series of vertical lines repre¬ 
senting the ordinates of the functions \an \ and <t>n corresponding to integer 
values of n. For this reason they are referred to as line spectra. 

The square-wave function of Fig. 9, for example, yields, according to 
the formula 176, 


[ 178 ] 
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or, the change of variable / —»/ — ir/« being made in the first integral, 

Integrating and substituting limits give 

(1 - (1 - cos wtt) 


Ivnj 


■KTtJ 


Hence 


r 0 for n even 

2 


Ijirn 


for n odd 


[180] 


[181] 


Substituting this result into the sum 175 and combining the conjugate 
terms yield the series 


m 


4 r sin oit sin 3cu/ sin 5co/ 




+ 


+ 


+ 


[182] 


3 5 

which checks Eq. 172 for x = ul. The amplitude and phase functions are 

^ . [183] 


\otn\ — — (for n odd) 
vn 


which may be written 


\a{m,))\ = —(for » odd) 
TT nw 


[184] 


and 


0^ — — 


[185] 


Since the phase function is a constant, there is no need to plot it. The 
plot of the amplitude function 183 or 184 is facilitated through plotting 
first a continuous dotted curv^e for this function, assuming 'ttw to be a 
continuous variable, and then erecting a set of ordinates from the wcj-axis 
to this dotted curve at the points corresponding to odd integer values of 
as is illustrated in Fig. 11. The dotted curve in this example is simply 
a rectangular hyperbola. After this dotted curve is drawn, any number of 
lines are readily inserted. A plot of this sort gives one a good idea of the 
rate of convergence of the series, since the ordinates are proiX)rtional to 
the values of the various harmonic amplitudes. 

A second interesting example is given by the function shown in Fig. 12. 
This consists of a periodic succession of identical rectangular pulses of 
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unit amplitude and duration 5, with the time origin chosen at the center of 
one of them. Application of the formula 176 in this case yields 


i 



Fig. 11. The amplitude function in the Fourier analysis of a rectangular wave. 


which is preferably written 


8 . 8 
sin fKi) “ sin n<ij - 

2 0 2 



[187] 


Since the expression is real, the phase function in this example is zero, as 
is to be expected from the fact that the function /(/) is even. 



Fro. 12. A periodic succession of rectangular pulses 


The amplitude function has the form (sin x)/x which is equal to unity 
at * = 0 and zero at integer multiples of t. The general appearance of 
this function is that of a harmonic oscillation of decreasing amplitude, 
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although it is, of course, not simple harmonic. At the point x = t/2 the 
value is 2 /t; at x = 3v/2 it is (l/3)(2/V); at a: = 5ir/2 it is (1/5)(2 /t), 
and so forth, the maxima and minima lying approximately at the points 
X = 37r/2, Sw/l, ■ ■ ■. With these items in mind a dotted curve showing 
the function 187 versus «w is readily plotted. It remains to draw in the 
ordinates corresponding to integer values of n. Before this can be done 
one must choose a particular value for the ratio of the duration 5 of the 
impulse to the fundamental period t. For the present example, this ratio 
is chosen as 


5 

T 


1 

5 


[188] 



Fig. 13. The amplitude function in the Fourier analysis of the succession of 
rectangular pulses of Fig. 12. 

and since r = 27r/aj, this choice corresponds to a fundamental angular 
frequency of 

1 27r 

CO = -• — 

5 5 

As shown in Fig. 13, the point wco = 2ir/8 marks the first zero of the 
dotted curve, and since the fundamental frequency corresponds ton — 1, 
this point is located one-fifth the distance from the origin to the point 
no) = 27r/6. The various ordinates for other integer values of n are then 
readily drawn. For the particular choice indicated in Eq. 188, the ampli¬ 
tudes of the fifth, tenth, fifteenth, • • • harmonics are zero because these 
points coincide with the zeros of the dotted curve. 

It is to be observed that the form of the dotted curve is the same 
regardless of the ratio 8/ r, and that only the spacing of the lines in the 
spectrum is dependent upon this value. Incidentally, the amplitude of 
the constant component, corresponding to w = 0, is seen to be the largest. 
All amplitudes are proportional to the duration 5, so that as the ratio 
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hiT is decreased, r remaining constant, the dotted curve remains intact 
except for a change in the scale factor for its ordinates. 

10. Power products and effective values 

In the discussion of problems in electric circuit theory, determining 
the average value of the product of two periodic functions is at times 
necessary. Since this product is again a periodic function with no larger 
fundamental period, it is sufficient to restrict the evaluation to one period. 
If the two functions are denoted by/i(/) and /zO), the problem ralU 
for the evaluation of the integral 

J = [190] 

This evaluation is particularly simple if the complex form is used for 
the Fourier series representation of the functions/i (/) and/zC/). These 
functions may be expressed as 


/l(0 = 2 : 

n «■ — • 

[191] 

and 


/2(0 = r 

m =■ — • 

[192] 

The product is given by the double sum 


/i(0 -hH) = i 

[193] 


n, m = — w 


Substituting this expression into the integral 190, and assuming that 
the series 191 and 192 are uniformly convergent so that the integration 
may be carried out term by term, one has 

/ = ;r 2 [194] 

2irn,m--- •/O 

The integral involved here is a very simple one. Its evaluation reads 

2t 

— form = —n 
" [195] 

0 for f» —n 

Consequently all the terms in the double sum 194 vanish except those 
for which tn — —n. The function J, however, still requires an infinite 
sum for its representation, that is, 

J = H a«i8-n 


r ir/« pj{n-^m)2r _ 

j{n + m)u) 


[ 196 ] 
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which is the desired result. It may be written in the alternative form 

7 = aoiSo + £ (a„|9_„ + [197] 

n ■»! 

or, if one writes, 

[198] 

the result 197 is found to be equivalent to 

00 

J = aoPo + 2 J: \a„0„\ cos (^„ - </.„) [199] 

n =1 

Because the integral 195 is zero for m ^ —n^ the interesting result 
follows that the average value 190, given by 199, depends only u}X)n the 
products of the amplitudes of harmonic components of like order. In 
other words, none of the cross-product terms resulting from the product 
of the two series for/i(/) and / 2 (/) contributes to the average value of 
this product. In a physical problem in which/i(/) represents a source 
voltage and/ 2 (/) the resulting source current, J represents the average 
power delivered by the source. I'he integral 190 is, therefore, also referred 
to as the power product of two periodic functions. The coefficient 
cos (\kn ““ <t> 7 i)) which occurs in Eq. 199, is in electric circuit problems 
called the power factor corresponding to the harmonic of nth order. 

A very closely related problem is the evaluation of the integral 

which is referred to as the mean square value of the single periodic funo 
tion/(/). This is, however, merely the integral 190 for J\ (/) = /2(7) = /(/), 
and hence the desired result is expressed by Eq. 196 or 199 for 
Hence, if /(/) is assumed to be given by Eq. 191, 

7' = ao"* + 2 E |a„P [201] 

n =1 

The square root of this value is called the root-mean-.square value or 
effective value of the periodic function fit). Recalling, according to Eqs. 
94 and 135, that the harmonic amplitudes Cn in Eq. 95 are given by twice 
the magnitudes of the complex coefficients one sees that the effective 
value of the periodic function /(/) is given by the expression 

[/(Oleffective = + “ £ Cn" [202] 

which contains the particular result that the effective or root-mean-sejuarc 
value of a sinusoidal function equals its amplitude divided by \ 2. 
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11. Summation formulas 

It is useful to note that the Fourier series for various particular func¬ 
tions may be used to obtain in closed form the values for numerous 
special forms of infinite scries. For example, from the function hix^ of 
Fig. 8 and its series 141, or from the function/(x) of Fig. 9 and its series 
172, one obtains by setting x = jr/2 the result that 

- 

Similarly, since the scries 174 for the triangular function of Fig. 10 is 
still uniformly convergent for x = 0, one has 

The evaluation of many other infinite series may be obtained in this way. 



Fig. 14. A plot of the function of Eq. 205, the Fourier series of which is used in 

several summation formulas. 


It is of greater practical value to recognize that similar means may be 
employed for the delenriination of more general summation formulas. 
For examfile, one may consider the function f{x) defined by 


f{x) = sin M ^ + xj (for -tt < < 0) 

/(.r) = sin A' ^2 ~ 0 < a: < ») 


[205] 


in which m may have any value. This function is shown plotted in Fig. 14 
for the value n = ‘H. The function is even and satisfies the condition 
98. Hence its Fourier series is represented by a cosine series with odd 
harmonics, and the coefficients are given by the formula 105. Substituting 
from Eq. 205, one has 

a„ = - fi.x) cos nx dx = sin m cos nx dx [206] 
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The integration yields 

2n sin nx sin /jl^ — — 2fi cos nx cos ^ 


an 


- M^) 


Jo 


2fl(l — cos Ht) cos M 
' Tr{n^ - M"") 


or 


an = 1 


/I ^ 

4/x cos /X - 


(for n odd) 


Tr(n^ — /x^) 

0 (for n even) 

The Fourier series for this function is, therefore, given by 


AfjL cos fjL - 

m -- z 


cos nx 


n=l,3,6, ••• 


[207] 


[208] 


[209] 


which converges uniformly for all values of x since the function f{x) is 
continuous. Substituting from the relations 205, one may write for the 
interval 0 < x < w 


IT sin 



4m 


TT 

COSM 2 


CO 


r 

n ■■1,3,6, ••• 


COS nx 

— M* 


[ 210 ] 


Particularly, for * = 0, this result yields 



r 

■ 1,3,5. • 


(n" 


[ 211 ] 


which is the partial fraction expansion of the tangent function, and is 
found to be a useful summation formula in connection with a number of 
problems in circuit theory. 

Other formulas may be developed from the relations 210 and 211. 
For example, subtracting the former from the latter, and using the 
trigonometric identity 


1 — cos »« = 2 sin^ n - 
2 


[212] 
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one finds 

*)| » sin^ n % 

— = Z -T-F—^ [213] 

which is a somewhat more general summation formula than Eq. 211. 

Now writing the Eq. 213 first for ti = in and again for m = ix^, and 
subtracting the second from the first, give a more general formula which 
reads 




*■ jsin M ^ - sin M - 


8/x cos I 


■ 2 * 

/(mux) -f(po,x) ^ 

The quantities a*, mij and jU 2 in these formulas may have any real or 
complex values. 

Formulas having the form of Eqs. 213 or 214 are useful in electric 
circuit theory because the quantities (w^ — have the form of the 
resonance factors of an impedance function. Since the latter is a rational 
function, that is, a quotient of polynomials, it is always factorable in 
terms of the roots of these polynomials. Hence the impedance is ex- 
fire.ssible as the (juotient of products of factors of this type. The expression 
for the jx)wer absorl.)ed by an electrical network which is excited by a 
periodic source containing only odd harmonics (this case is most com¬ 
mon) assumes the form of the inlinite sum in Eq. 214 when the network 
contains two degrees of freedom. 

For /X 2 0, a special form of Eq. 214 results, reading 



Sf(iJi,x) — irX 

~ . 


n 


«o 

Z 

1.3.5,!-•• 


• 2 * 
Sin'' n - 




[215] 


Other formulas may be obtained through differentiation of the preceding 
ones with respect to x. As long as the coefficients in the resulting series 
decrease for large values of n as rapidly as, or more rapidly than, the 
ratio 1 /m‘, then, according to Art. 8, the periodic function represented 
by the series is continuous, and the series still converges uniformly for 
all values of x inclusive of the boundary values in the relations 205. 
Jlowever, if the coefficients in the resultant series decrease for large 
values of n only as fast as the ratio 1/m, the series cannot be used for the 
boundary values of x, although it still converges uniformly for all other 
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a:-values. For example, differentiating the formula 213 with respect to x 
gives 


r cos /i 



4 




00 


r 


n sin nx 
(«2 - 


[216] 


which is evidently no longer valid for x = 0 or a: = tt. However, differ¬ 
entiating the formula 215 with respect to x yields 


TT cos /X 



T 

TT cos M 2 


4/1^ cos fi 


T 

2 


eo 


z 

n= 1 . 3 . 5 .- • • 


sin nx 
n{n^ — 


[217] 


which converges uniformly for all a;-values. 

The formula 214 may be generalized so as to contain any number of 
factors («'* — in the sum. Replacing jui and /U 2 respectively by ju 2 
and 1 X 3 and subtracting the resulting formula from 214 yield 

fifilyX) __ f{lX2,x) __ f(fX3,x) _ 

(Ma^ —W^)U2“-Af3^) (m'^-Mi'0(M3^— 

Again, replacing /X 2 , Ms in this formula by M 2 y MSy M 4 respectively and 
subtracting the resulting formula from 218, one finds 

^ _ fiMkyX) _ 

A;-l {Mk^ — Mk+l^){Mk^ — Mk^i^){Mk^ “ Mk^S^) 


« sin2 n - 

n-ilfs.--- (n^ - ~ 

in which the subscripts ^ = 1, 2, 3, 4 are assumed to form a cyclic group. 

Any desired further generalization is evidently possible. For example, 
by using Eq. 213, and forming the function a/(/xi,:r) + bf{ii 2 y 0 c), one 
obtains a formula which differs from Eq. 214 in that the terms in the sum 
contain a factor of the form (n^ — Mv^) in the numerator in addition to 
factors of this form in the denominator. 
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12. The ‘‘least squares” approximation property of the 
Fourier series 


In this article the problem of finding a trigonometric series representa¬ 
tion for a given function j{x) is approached in a different manner. The 
trigonometric series which is to approximate the function j(x) is assumed 
to be finite and is written in the complex form 

5n(ic) = f [220] 

k = —n 

The following question is now raised: What must be the values of the 
coefficients in order that the mean square error between f(x) and 
5n(x) may become a minimum? In analytic form the mean square error, 
expressed for the fundamental range, reads 

1 /»a-f 2ir 

E = ~ f [fix) - Snix)Ydx [221] 

Itt O a 


The problem, therefore, is to determine the coefficients in Eq. 220 in 
such a way that the expression 221 becomes a minimum. 

Now 

[fix) - SnO>c)]^ = U(x)Y + [ 5 n(a;)]^ - 2 [fix)Snix)] [ 222 ] 


According to Eq. 220, 

[Snix)f= i [223] 

i,fc=-n 

SO that 


2ir 


^0+2. 

/ [s„(a:)]2Jx 



didk 


/•o+2» 

I dx 


[224] 


The integral appearing here has the same form as that in Eq. 195 of 
Art., 10. Hence 


j 

27r 


X a + 2ir 


n 


Z 


ata^k 


[225] 


Next one needs to evaluate the integral 

1 /•a + 2ir n f 1 /•a + 2ir 1 

— I fix)snix)dx= 2 0k\— I fix)e’'‘’dx\ [226] 

2 ir * 4 a [ZTTt/o J 

The quantity enclosed by the cur\^ed brackets is, according to Eq. 122 or 
Eq. 156, recognized to be the expression for the complex Fourier coefficient 
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uk, so that 

I f(x)s„(x)dx = 2 ; [227] 

Substituting Eq. 222 into Eq. 221, and taking note of the results stated 
in Eqs. 225 and 227, one obtains for the mean square error the expression 

I na-\-2x n n 

£ == 5 - / [S{xWdx+ 2 ; UkO^k - 2 2 ) a-ko-k [228] 

iTTt/a Jk---n k~-n 

Now it is observed that 

2 dko^k = 51 + CL-~-kotk) [229] 

k » —n fe = - n 

The last two terms in Eq. 228 may, therefore, be written in the form 

n n 

5^ {ajcd^k ~ -k — + Otka^k) — [230] 

k = - " n - — n 

which is equivalent to 

n n 

(^ifc Jk — oc^k) ~ [231] 

k = — k »* —-w 

or, since the coefficients with negative subscripts are the conjugates of 
those with the same positive subscripts, these terms are given by 

r W-akl^- i [232] 

Af ■* ^ —n 

Hence the mean square error, according to Eq. 228, is seen to be given 
by 

1 pa+2x n n 

£ = 7 - / [/(x)rdx+ 2 : k-a*p- 2 : kl" [233] 

Inasmuch as the function f(x) and hence also the coefficients are fixed, 
the expression 233 evidently becomes a minimum for 

ak = ak [234] 

whence one may conclude that the sum a,s given by Eq. 220 approxi¬ 
mates the stated function/(x) over its fundamental range so as to make 
the mean square error a minimum if the coefficients in the finite sum s,i(x) 
are the Fourier coefficients for the function f(x). 

When the coefficients Ok are so determined, the mean square error 233 
becomes 

1 /*tt-f-2ir n 

E = r 2: k 

Z7r«/a 


2 


[235] 
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which, according to Art. 10, is 

£= £ kl"- T. kP [236] 

k^ — to Jbta— n 

Thus it is seen that the mean square error tends toward zero as n becomes 
larger and larger. In other words, the infinite Fourier series approximates 
the given function/(x) in such a way as to make the mean square error 
over the fundamental range vanishingly small. The Fourier series, or 
any of its partial sums, is, therefore, said to approximate a given function 
in the “ least squares ” sense. 

In view of this result it is easy to show why, at a point of discontinuity 
of the function f(x), the Fourier series always yields the arithmetic mean 
between the two values of /(x) immediately adjacent to the point of dis¬ 
continuity. Thus, if these two values are denoted by a and b, and the 
value of the series at the point of discontinuity is denoted by 5 , the mean 
square error at this point is expressed by 

(s — aY + (s -- bY 

2 


[237] 


If this is to be a minimum, its derivative with respect to $ must be zero, 
that is, 

5 — a.+ 5 .— 6 = 0 [238] 


which yields 


5 


Q b 

~T~ 


[239] 


13. The approximation property of the partial sums; the 
Gibbs phenomenon 

When, in a practical problem, a trigonometric scries is used to approxi¬ 
mate a given function, this series must for obvious reasons be a finite one. 
Consequently, it is of considerable interest to know more about the 
detailed manner in which the partial sums of a Fourier series approximate 
a prescribed function. 

A partial sum reads 

5„(*) = f [240] 

in which 


[ 241 ] 
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Substituting this expression for at into Eq. 240 and reversing the order of 
summation and integration yield 

Snix) = I rV({) i: dk [242] 

ZTt/O &=—n 

Now 

f = 5 + cos (ic — i) + cos 2(x — {) + ••• + cos n{x — {) 

Aj «—fi 

[243] 

and, according to Eq. 11, this gives 

„ sin|(2M + 

L -7- 

t--n . (X - 

2 / 

Substituting this result into Eq. 242, one finds that a partial sum may be 
expressed as 

Sn(x) = I £^m)n ({ - *) di [245] 

in which 


«(? -») = 


This function is shown plotted versus ^ in Fig. 15 for the particular 
choice « = 5. It consists of a periodic succession of identical large humps 
with the amplitude (2« + 1) and the fundamental period 2v, separated 
by a number of smaller oscillations which decrease in amplitude with 
increasing distance from the large humps, the smallest of these having 
unit amplitude and occurring midway between any two of the large 
humps. It is observed that only one large hump is encountered throughout 
the fundamental range 0 g a; g 2x, and this occurs at the point { = x. 

According to the relation 245, the partial sum s„(x) is given by the 
product of this peculiar function «({ — x) with the given function/({) 
integrated over the fundamental range. The integration must be evalu¬ 
ated separately for each value of x for which the corresponding value of 
^„(x) is desired. During each integration, x is treated as a constant. The 
fimction «({ — x), which contains x as a parameter, remains the same 
for various x-values except for a translation of this function as a whole. 



[244] 
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The value of x merely determines the location of the large hump in the 
fundamental range. 

f^igure 16 illustrates the function «({ — x) for a fairly large value of n, 
and shows its position in the fundamental range relative to the given 
function /({) for some arbitrary or-value.* For the interpretation of 
the integration in Eq. 245 one may visualize the plane of Fig. 16 as a 
screen on which the function — x) is plotted and of which the portion 
corresponding to the shaded area under this curve is cut out. The func¬ 
tion /({), which is plotted on a second screen located behind the first, is 



Fig. 15. The scanning function used in a study of the Gibbs phenomenon. 


assum(‘d to be visible only through the portion of the first screen which 
is cut away. For a large value of w, this cutaway portion is essentially 
in the fonn of a long narrow slit corres}Kmding to the area under the 
large hump in the function — x). If one neglects for the moment the 
small areas under the minor oscillations or ri{)ples adjacent to this slit, 
and assumes further that this slit is sufficiently narrow so that the small 
portion of the function/(^) visible through it may to a first approxima¬ 
tion be regarded as characterizing the single ordinate of this function 
for the point f = x, it becomes clear that the value of the integral 245 
is given simply by the product of f(x) and the area of the slit multiplied 
by l/27r. If l/27r times the area of the slit equals unity, the value of the 
integral, to a good approximation, equals f(x). In other wx)rds, one arrives 
at the reasonable conclusion that Xn(x) ^.f(x). 

*Since the ratio of the height of the large hump in the function ui^ — x) to the width of 
the fund5.mental range is (2n -f- l)/ 2/r, it is not practically feasible to draw this figure, or 
Fig. 20, in correct proportion with regard to this ratio. These figures are, however, in correct 
proportion with regard to the ratios of the amplitude of the large hump to those of the adjacent 
oscillations, as well as with regard to the ratio of the width of the fundamental range to that 
of the large hump at its base. This ratio is equal to » -f- Fa. 
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The values of 5n(*) for various values of x are obtained through dis¬ 
placing the first screen in the horizontal direction so that the slit uncovers 
different portions of the curve /({) corresponding to the point ^ = x. 
This process of moving the screen with the slit corresponding to «({ — x) 
across the fundamental range, and viewing the function /(|) through it, 
is referred to as scanning f(X) with the function «({ — x). The latter is 
called the scanning function. If this scanning function consists of a single 
rectangular hump of extremely small width but of such height that the 
area of the slit nevertheless is finite and equal to 2-k, the integral 245 
yields almost exactly the function/(x), the discrepancy becoming zero 



Fig. 16. Pertinent to the evaluation of the partial sum of a Fourier series. 

as the slit width is allowed to approach zero. Actually, because of the 
deviation of the scanning function u{i — x) from this ideal limiting 
form, the integral yields a function s„{x) which is only approximately 
equal to f{x). 

For a relatively small value of n (few terms of the Fourier series) the 
scanning function «({ — «:) deviates quite considerably from its ideal 
form, and the partial sum s„{x), as one should expect, only crudely 
approximates the given function f(x). As more terms are added to the 
partial sum, and n becomes relatively large, the form of the scanning 
function improves, and so does the degree of approximation between 
5„(a;) and f(x). The improvement in the scanning function is due to the 
large hump’s becoming taller and narrower, as .is clear from Fig. IS, in 
which it is indicated that the height of the large hump equals (2w -1-1) 
and its width at the base equals 4ir/(2« + 1). At the same time, the adja¬ 
cent ripples become larger in number and hence also become narrower, 
in the same proportion, in fact, as the large hump becomes narrower. 

One disturbing feature about the behavior of this scanning function 
with increasing n, however, is that the ripples immediately adjacent to 
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the large hump do not ultimately become smaller and smaller in amplitude 
relative to the height of the large hump but maintain amplitudes which 
asymptotically approach a finite ratio relative to the height of the large 
hump. The ultimate effect of this disturbing circumstance requires 
further careful investigation which is begun by study of the properties 
of the scanning function in greater detail. 

First it is significant to observe that the net area under the curve for 
over the fundamental range is indeed equal to 2 t, and that this 
is true for any w, as may readily be seen in several ways. For example, 
according to Eqs. 243, 244, and 246, 

w({—x) = 1 + 2 cos ({—^)+2 cos2(f—rr)H-+2 cos«(f—it) [247] 

In evaluating the integral of this expression over the range 0 < { < 2 t 
it is observed that all the integrals for the cosine terms yield zero. Hence 

r u(i — x) = f = It [248] 

t/O c/O 

This result may also be seen from the integral 245 through assuming as 
a special example that /({) = 1. Then Sn(x) must, of course, also equal 
unity; that is, the partial sum reduces to its constant term and this must 
have the value unity. The integral 245 then yields the result expressed 
by Eq. 248. 

Thus it is established that l/2ir times the area under the scanning 
function is equal to unity, as the preceding discussion indicates that it 
should be. However, this area is not confined to a single slit but is partly 
contributed to by smaller increments due to the ripples, which are alter¬ 
nately numerically positive and negative. A glance at the scanning 
functions shown in Figs. 15 and 16 reveals, moreover, that the net area 
contributed by the ripples is numerically negative so that the area under 
the large hump must exceed the value 2 t if the resultant area under the 
entire function is to have this value. The amount of the excess area 
under the large hump depends up)on the value of «, but the important 
point is that this excess does not become zero as n is indefinitely increased. 

In order to comprehend this fact, one must study the behavior of the 
function — x) for large values of w. To facilitate this study it is 
expedient to introduce in the form given by Eq. 246 the change of variable 

, = (2« + 1) ^ [249] 

Then the scanning function assumes the form 



[ 250 ] 
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The region of the main hump corresponds to — < 77 < tt, and each 

adjacent smaller hump corresponds to an increment of w in the varial)le 77 . 
As indicated in Fig. 16, the region over which the adjacent ripples have 
significant amplitudes is confined to the more immediate vicinity of 
the large hump. In other words, the entire region of interest for the 
function u{r}) is confined to a finite interval for the variable rj which, for 
example, may be described as — IOtt < 77 < IOtt, or something of this 
order. 

With regard to the expression 250, if 7i is sufficiently large so that 
approximately 


IOtt tt 

2fi “hi 6 


[ 251 ] 


little error is introduced in the determination of ti(rj) throughout the 
region of interest if the sine function in the denominator is replaced by 
its argument. In the limit n 00 any error introduced by this procedure 


■in f) 



Fig. 17. A plot of the function —~ which occurs many times in Fourier analysis. 

v 

becomes vanishingly small. Hence, for large values of one is permitted 
to write for the scanning function 

«(>?)= ( 2 « +.'[ 252 ] 

The function (siriTj)/?] has appeared before in these discussions (see 
Fig. 13 of Art. 9) and will appear again in a variety of problems. The 
reader may, therefore, well sjxmd some time becoming thoroughly 
familiar with its characteristics. It is plotted again in Fig. 17, v;hich 
illustrates some of its more immediately apparent properties. At the 
origin, 77 = 0, the function has the value unity, and a zero derivative, 
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as is apparent if one writes the Maclaurin series for (sin thus 


sin 17 




= 1 


„2 -4 

6 120 


+ 


[253] 


from which it is also clear that the function is even. At the points 
»? = ±jr, ± 2 ir, ■ • • the function passes through zero. Aside from the 
maximum at t; = 0 , the function has further maxima and minima at 
the points where 

or for 


tan T/ = 17 


[255] 


The roots of this transcendental equation are very nearly, and for suflTi” 
ciently large rj almost exactly, equal to 


V = 


T 





[256] 


Actually they are slightly smaller than these values, but as a sketch of 
the relation 255 readily reveals, the discrepancies even for the first few 
roots in the set 256 are hardly noticeable in a graphical representation. 
The values of these approximate maxima and minima are most con¬ 
veniently expressed in terms of the value of the function for 77 = zb 7 r/ 2 , 
which is 2/t. The approximate minimum at 17 — ±.3Tr/2, which is a nega¬ 
tive value, is one third of 2 / 7 r; the maximum at rj = iST 2 is one fifth 
of 2 / 7 r; and so forth. In other words, the maxima and minima in absolute 
value become smaller with increasing 17 like the ratio I /T 7 . For example, 
the fourth extremum at lTr/2 has the value 2/1 w = 0.091, or only about 
9 per cent of the value of the function at 17 = 0. 

With regard to the area under the curv^e of Fig. 17 it is significant that 
the function 

5z(jc)= r^dv [257] 

n/O T7 

which represents the area under the curve for (sin rj)/f] from the origin 
to some variable point 77 = x is a familiar function in Fourier analysis 
and allied matters. A short discussion of some of its properties may well 
be given at this time. 

The shaded area in Fig. 18 represents the value of the function Si (x), 
called the sine-integral of x/' for a particular value of x. The essential 
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properties of this function are easily obtained from inspection of this 
figure. 

First one may observe that for values of x near the origin, the area 
evidently increases very nearly, in fact for x == 0 exactly, as x. This 

circumstance may readily be seen by 
-2^ observing that the function (sin ri)/rj 

has a zero derivative (the curve is 
horizontal) at the origin. Hence 

(x)"] rocoi 


The shaded area is the sine- 
integral of X, 


X *{ curve for (sin 7))/ti begins 

Fig. 18. The shaded area is the sine- fall, however, the rate at which 
integral of x. Si (x) increases with x falls off, and 

it eventually becomes zero at x = ir. 
Here the function Si (x) reaches its first maximum. From x = ir to 
X = 27r the ^i-function decreases from its first maximum by the amount 
of the negative area enclosed by this portion of the (sin rj)/r) curve. By 


Si(x) 



Fig. 19. A plot of the sine-integral of x. 


the same sort of reasoning, it is readily seen that the function Si (x) 
has the general character shown in Fig. 19. The alternately positive and 
negative areas contributed by the ripples in the function (sin become 
smaller and smaller with increasing x values, and the net area, therefore, 
approaches a finite value asymptotically and in an oscillatory manner. 

The asymptotic value is readily obtained from the result stated by 
Eq. 248, namely, that the net area under the curve for the scanning 
function is equal to 2t for any n and any x. This equation may be written 

- x)di^ - x) = 


[ 259 ] 
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or, with the use of Eqs. 249 and 250, one has 

2 p(2n + l)wl2 gin ri 


2n + 


/ (2n + l)r/2 
•(2n+l)»/2 . 

Sin { 


■ dri = 2r 


i^) 

In the limit w —> oo this result reads 

2 - 2ir 

J~» rj 

and since the function (sin rj)/r] is even, it follows that 

X * sin t; t 

- di = - 

V ^ 


[260] 


[261] 


[262] 


which is the asymptotic value of the function Si (*), as indicated in 
Fig. 19. 

With regard to the evaluation of the integral 245 for large values of «, 
according to the scanning process illustrated in Fig. 16, several points of 
significance may now be brought to the reader’s attention. First it is to 
be observed from Fig. 17, which according to Eq. 252 represents the 
appearance of the scanning function for large values of n, that the smaller 
negative humps immediately adjacent to the large hump have amplitudes 
which remain slightly greater than one-fifth the amplitude of the large 
hump no matter how large « becomes. As already pointed out, the 
scanning function, therefore, does not approach its ideal form as n 
increases without limit, since the net area under the scanning function 
does not become equal to the area under the large hump. The latter 
area is, for large values of n, equal to twice the area under the curve of 
Fig. 17 between tj = — ir and n = ir. (The factor of two enters here because 
of the change of variable given by Eq. 249, as is also seen in the steps 
leading to Eq. 261.) This area is equal to 4 Si (t), which is found (from 
tables of 5t-functions) to be about 18 per cent larger than 2*-. 

In the limit » , the scanning function may be visualized as result¬ 

ing when all the side oscillations in Fig. 16, together with the large hump, 
are compressed so as to form a single ordinate of infinite height. The ex¬ 
cess area under the large hump then virtually becomes coincident with the 
residual areas of the ripples, and since the net area always equals 2v, the 
ultimate form of the scanning function may in a sense be said to have met 
the ideal requirements. Yet for any finite «, however large, there exists a 
departure from the ideal which has a definite effect upon the approxima¬ 
tion property of the partial sum Sn{x). This departure becomes particu¬ 
larly marked in examples in which the given function/(») possesses dis¬ 
continuities. 
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In order to illustrate this fact a function/(ac) is assumed to be zero 
from a: = 0 to X = Xi, and equal to unity over the remainder of the 
fundamental range from x = xi to x = 2ir. The integral 245 then becomes 

^ jf «({ - x) di [263] 

This expression may be replaced by the two integrals 

^n(*) = ^ f - x) di - f ' u(i - x) [264] 

Zir*/x ZtcOz 



Fig. 20. The scanning function for w = 28 applied to a rectangular pulse. 


These manipulations are clarified by reference to Fig. 20, in which the 
scanning function for » = 28 as well as the particular function /({) con¬ 
sidered in this example is plotted. Thus it becomes clear that the first 
integral represents X/It times the area under half the scanning function 
and, therefore, has the value f. By use of Eqs. 249 and 252 in the second 
integral, the relation 264 becomes 


Sn(*) = 


ar)/2 sJn rj 


drj 


[ 265 ] 


which, according to Eq. 257 is equivalent to 

Snix) = J + - 5 t [(» + ^)(x - Xi)] [ 266 ] 

Z TT 


This expression shows how the discontinuity of the function/(:r) at 
X Xi is represented by the partial sum The second discontinuity 

at a: = is represented in an exactly similar manner, with the result 
that the partial sum for this periodic function f{x) and the choice » = 28 
assumes the form shown in Fig. 21. 

It must be admitted, of course, that a discontinuity in the function/(:r) 
offers an extreme test of the ability of the partial sum Sn(^) to approxi- 
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mate this function. In other words, for a continuous function f{x), the 
partial sum with the same number of terms yields a vastly better 
degree of approximation. Nevertheless, it is practically significant to 
investigate the approximation property of the partial sum in the most 
adverse circumstances. In this respiect one observes from the appearance 
of Fig. 21 that residual discrepancies remain even for very large values 
of n. As the latter is further increased, this figure is changed only in that 
the ripples in the vicinity of the discontinuities of f{x) show a propor¬ 
tionately increased rate of oscillation versus the variable x, whereas their 
amplilttdes relative to the magnitude of the discontinuity remain the same. 



Fig. 21. The result of the operation illustrated in Fig. 20. 


In the limit n —> w, these ripples are compressed into a single vertical 
line at the pioint of discontinuity, but even in this limit the Fourier series 
is still observed to yield the ovcrswing of 18 per cent* which is charac¬ 
teristic of the function Si (x). It is true, of course, that in the limit« —> oo 
this overswing together with the adjacent ripples occupies zero space in 
the fundamental range, so that practically speaking one may say that no 
residual discrepancy between the scries and the function remains. Never¬ 
theless, the phenomenon is noteworthy from a mathematical standpoint 
inasmuch as it illustrates the ultimate effect of the failure of the scanning 
function properly to approach its ideal form in the limit « —» «=. It is, 
moreover, of practical concern also since it reveals the disheartening fact 
that, by means of a finite portion of a Fourier series, a given function can 
never be approximated in the vicinity of a discontinuity with a tolerance 
less than the characteristic 18 per cent overswing, no matter how many 
terms one may be willing to use. 

This peculiarity of the Fourier series, referred to in mathematical terms 
as the Gibbs phenomenon, is a very real disadvantage with regard to 
certain practical problems. Because of this phenomenon, it is necessary 
in connection with certain approximation problems to use other types of 
trigonometric series which are appropriate modifications of the Fourier 

•This percentage is based upon half the value of the discontinuity. In terms of the whole 
discontinuity the overswing is 9 per cent. 
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series. An important modification of this sort is discussed in the next 
article. 

14. Approximations by means of Fejer polynomials 

The appearance of the Gibbs phenomenon in the Fourier series is evi¬ 
dence of the failure of the unifonn convergence of that series in the 
vicinity of a discontinuity of the given function. In other words, the 
partial sums Sn(x) no longer converge toward a definite limit with increas¬ 
ing n for the immediate vicinity of a point of discontinuity of f{x). It is 
the object of the present article to show that this failure in the uniform 
convergence of the series, and the associated Gibbs phenomenon, may be 
removed if the sequence of the partial sums 5n(^) is replaced by the 
arithmetic mean sequence defined by Eq. 146 of Art. 9, Ch. VI. 

This sequence reads 

Sq{x) = So{x) 

S.W - P67] 

S,ix) = —^ X. Jn{*) 

Substituting from Eq. 240, and utilizing the notation 

= [268] 

one recognizes that this sequence may alternatively be expressed as 
5o(*) = ao = J 

5i(a:) = ao + \ci COS (x + <t>i) 

‘5*2 (^) = «o + cos (^ + 0i) + ^C 2 cos {2x + 02 ) [269] 


V — 1 y — 2 

S,(x) = ao H- - — Cl cos (x + 0i) H- - — C 2 cos (2* + ^ 2 ) 

+ • • • - c, cos (»'* + 6,) 

V 


V 
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The coefficients a* are the Fourier coefficients defined by Eq. 241, and 
hence the partial sums appearing in Eq. 267 are, according to Eqs. 245 
and 246, given by 




sin 

[ (2n + 1) ^ 


sin ■ 

ff-^1 


[ 2 J 





[270] 


For the following manipulations it is now useful to observe that 


sin (2«+ 1) 


( - X 


sin I (2» + 1) 


f-x 


sin 


(^0 


sin(V) “"’(V) 

_ cos w({ — x) — cos [( w l)(f — x)] 

By use of Eq. 270 in the last of the relations 267, it is found that 


[271] 


SM) - L fm t cos »(i - X) - cos + !)(;-,)] 


But 


[272] 


Z |cos«({-x)- cos[(m+1)({-x)]}=1- cos ({-x)+ cos ({-x) 

n —0 

— cos 2({ - x) + cos 2({ — x) - • • • - cos {v + 1)({ - x) 

= 1 - cos (.7 + 1 )« - x) = 2 sin^ { (V + 1 ) j [273] 
Hence Eq. 272 becomes 

1 

. [274] 


Syix) = ^ jf /U) • vii - x) • df 


in which 


i;({ - x) 


fsinj 


»+ 1 


("+ 1 ) 


$ - x]\ 


[275] 


sin 

The expression 274 for the trigonometric polynomial Sr(x) is identical 
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with the form 245 for the partial sum Sn(x) except that the scanning 
function now is — x), as given by Eq. 275, instead of — x) as 
given by Eq. 246. Comparing the function w(f — .r) with v(^ — x) shows 
that the latter is essentially the square of the former. With v = 2n, this 
simple relationship between u{^ — x) and — x) is true except for the 
factor !/(>'+ 1) in the expression for — x). But for this scale factor, 
the plot of Eq. 275 for v = 10 is simply given by the square of the function 
— x) plotted in Fig. 15 for n = 5. The result is illustrated in Fig. 22. 



Fig. 22: A plot of the scanning function that results when Cesaro summation is 

applied to a Fourier series. 


A comparison of Figs. 15 and 22 clearly reveals the superiority of the 
scanning function — x) over the function w(f — x). Most significant 
in this respect is that the present function has no negative values, from 
which it follows that, at a point of discontinuity of the function /(x), the 
partial sum 5^(x) cannot overswing. Moreover, the ripples adjacent to 
the large hump in the function v{^ — x) have considerably smaller 
amplitudes than those for the function — x). 

The net area under the scanning function — x) for the fundamental 
range is again equal to 27r, as may most easily be .seen through considering 
the integral 274 for the special case/({) = 1, whence ^^(x) must also 
equal unity. Since the function v{^ — x) has the period 27r, it is thus 
established that 


1 


27r(*' + 1) 


n£ 


^sin I (y + 1) ^7-- 


II 


sin (V) 


= 1 


[276] 


for any x and any v. 
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With the change of variable 


^ = (k + 1) 


the function 275 becomes 


V(f,) = 


f - * 


Sin ij 


>'+ 1 


[277] 


[278] 


sm 




For large values of p the scanning function is, therefore, very nearly 
given by 


,(,) . (, + 1 ). 

The integral 276 then reads 

1 /sin rjy^ 

T*/—(i'+l)»/2 \ 7f ) 


and for oc one has 


1 r* /sin 17Y 

7rt/-« \ 7) J 


dy) ^ I 


[279] 


[280] 


[281] 


From Eq. 279 it is found for large I'-values that the area under the 
large hump in the scanning function — x) is equal to approximately 
90 per cent of the total area of 2^, and that the combined area under the 
two small humps on either side is about 5 per cent of the total area. 
The amplitude of the small humps immediately adjacent to the large one 
is about 4.5 per cent of the large amplitude. These ratios hold for reason¬ 
ably large finite values of v (about 10 or more) and do not vary as v is 
increased without limit. 

With this scanning function, the function /(f) of Fig. 20 yields a 
partial sum Syix)y according to Eq. 269, which has the form shown in 
Fig. 23. In order that this figure may correspond to the same width of the 
large hump and of the adjacent ripples relative to the fundamental range 
as for the scanning function of Fig. 20, it is drawn for p = 56, which is 
double the «-value chosen for Fig. 20. In other words, it is necessary to 
have twice as many terms in the partial sum 269 as in the partial sum for 
the Fourier series in order to obtain the same slope at the points of dis¬ 
continuity of the function f{x). However, the Gibbs phenomenon is now 
completely suppressed. Instead, the increment in Sp(x) near the point Xi 
equals only about 90 per cent of the value of the discontinuity, corre¬ 
sponding to a displacement of the scanning function i»(f — x) by an 
amount equal to the width at the base of its large hump. A succeeding 
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displacement equal to the width of the next adjacent small hump yields a 
further increase in S,{x) of about 5 per cent, and so on. 

The essential difference between the behavior of the partial sum 
S,.{x) and that of s„{x) in the vicinity of a discontinuity of the function 


kS,(x) 



Fig. 23. The result of scanning a rectangular pulse with the scanning function of 

Fig. 22. 


f(x) may be seen from a comparison of the function Si (x), defined by 
Eq. 257 and illustrated in Fig. 19, with the function 

Q{x) = dr, [282] 

The latter is shown plotted in Fig. 24, in which the dotted curve rep¬ 
resenting Si (or) is also drawn in order to facilitate the comparison of 
these two functions. They both have the same asymptote, but Si (x) 
converges toward this value in an oscillatory manner, whereas the 
function Q{x) approaches it monotonically. 

The conclusion is that the so-called Fejer sum 6\(x), given by Eq. 269, 
converges toward a definite value as v is indefinitely increased, even at 
points where the given function f(x) is discontinuous. In other words, the 
Fej6r series, which is given by 5v(x) for , converges uniformly over 

the entire fundamental range even when the function f{x) which it 
represents possesses discontinuities. 

It is interesting to obsen^e, -according to the relations 269, that for 
large values of v the coefficients in the sum Sy{x) dilfer appreciably from 
those in the sum 5n(^) only for the higher harmonics. In other words, the 
coefficients of the initial terms are practically the same in the Fej6r sum 
as they are in the partial sum of the corresponding Fourier series when 
the total number of terms is large. This fact means that as the number 
of terms becomes infinite, the coefficients for any finite number of terms 
are actually identical. The two resulting infinite series differ only in their 
terms of infinite order.* 

*This is admittedly a rather loose way of referring to the higher order terms in a partial 
sum as the number of terms in that sum is allowed to increase without limit. 
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From a practical point of view this circumstance may at first sight 
seem trivial, inasmuch as the terms of infinite order can never be reached 
in any term-by-term calculation. Nevertheless, there remains a significant 
difference in the behaviors of the two series, in that one of them exhibits 



Fig. 24. Essential difference in the behavior of the partial sum of a Fourier series 
and that of a series of Fejer polynomials in the vicinity of a discontinuity. 


the Gibbs phenomenon at any point of discontinuity and the other does 
not. This difference is due precisely to the difference in the terms of 
infinite order because these are the ones which alone are significant in 
determining the approximation properties of the series in the vicinity 
of a discontinuity. 

15. Fourier analysis by graphical means 

In practice it frequently occurs that the function f{x) for which a 
Fourier series representation is wanted is available in graphical form 
only. Usually also in problems of this sort only a partial sum 5n(:x^) is 
sought which approximates the function f{x) with a certain stated 
tolerance. Before discussing a possible method of solution, it may be well 
to point out that the precise requirements of the desired solution in a 
problem of this kind are frequently not clearly stated, and hence that 
considerable confusion regarding the value of a particular solution may 
result. 

The problem is frequently put very roughly in the statement that 
a finite trigonometric polynomial of the fonn of Sn{x) is sought which 
approximates a given function, but usually nothing is said about the 
approximation properties of the desired polynomial except perhaps that 
the ‘‘ best approximation which a given number of terms can yield is 
wanted. Inasmuch as there are an infinite variety of ways in w’hich a 
trigonometric polynomial with a given number of terms may approximate 
the required function /(x), the solution is decidedly not unique. For 
example, the polynomial may approximate f{x) so as to make the mean 
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square error a minimum, in which case the solution, according to Art. 12, 
is given by the partial sum of a Fourier series. On the other hand, the 
polynomial may behave in such a way that all the maximum discrep¬ 
ancies which occur between certain of its values and the corresponding 
ones of /(x) are equal in magnitude. In other words, all the maximum 
deviations of the polynomial from the function/(a:) are equal. In this 
case the pol)momial is said to approximate/(:r) with a uniform tolerance. 
This sort of behavior generally yields the smallest tolerance for a given 
number of terms, and it may quite appropriately be said to represent 
a “ best approximation,’’ yet the mean square error does not become 
a minimum. Another reasonably good approximation may be had from 
the Fejer sum Sv{x), For it the mean square error is not a minimum 
either, but this should not preclude consideration of it, because there 
usually is no particular reason why a minimum mean square error should 
be the ruling requirement. In other words, since there are numerous 
other approximation behaviors which with equal or better right may be 
regarded to be good ” or best approximations,” there is no a priori 
reason why a Fourier sum should be looked upon as the solution. In fact 
there may be good reasons in certain problems why the Fourier sum 
should be avoided, one such reason being that the Fourier sum yields 
a nonuniform tolerance in the vicinity of a p)oint of discontinuity. 

It is important to remember in connection with these thoughts that 
such a variety of possible solutions is markedly different only when the 
total number of terms considered is not too large, although there are 
always significant differences in the terms of high harmonic order no 
matter how large n may be. This point is illustrated by the comparison 
of the functions Sn{x) and St>{x) given in the preceding article. In the 
limit w —> 00 , all possible methods of approximation which converge 
toward/(a:) must yield identical terms for all finite harmonic orders, 
but for any finite n the higher order terms may vary significantly, for 
these ultimately characterize the respective approximation properties of 
various types of partial sums. 

In practice these considerations may raise the question of what har¬ 
monic amplitudes one may expect to obtain from experimental measure¬ 
ments made on an unknown source with a detector which is almost 
perfect with regard to harmonic selectivity. Experimental errors being 
neglected, the answer to this question is simple inasmuch as a physical 
source cannot generate harmonics of infinite order and hence its periodic 
function must be given by a finite sum. The perfect detector measures 
the amplitudes of the harmonics in this finite sum. 

Because of the imperfections present in any practical measuring 
system, however, the results of such a measurement yield a partial sum 
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which is not correct but merely approximates with a certain tolerance 
the resultant function represented by the correct one. Since there are 
any number of other partial sums which also approximate the given 
function with the same tolerance, it is difficult to know how to interpret 
the measured values. 

It is common practice to assume that the measured polynomial approxi¬ 
mates the partial sum obtained from a Fourier analysis (or what is 
thought to be a Fourier analysis) of the resultant function/(x) as recorded 
by an oscillograph. One frequently reads in reports on experimental 
work of a comparison between ‘‘ calculated ’’ and measured values 
of harmonic amplitudes. Such comparisons are somewhat meaningless, 
not only on account of the residual inaccuracies in the calculated and 
measured values, but primarily because there is only a remote chance 
that they correspond to the same approximation behavior in the partial 
sums which they represent. 

For example, the given source function may closely resemble the 
rectangular wave of Fig. 9. Now if this function is approximated by 
a finite trigonometric polynomial in such a way as to yield a uniform 
tolerance, a relatively small number of tenns (for example, about 10 or 
15) suffice to reproduce the function with residual discrepancies which 
in ordinary circumstances are well below the threshold of detection on 
a cathode ray screen or on a graphical plot, yet the resulting harmonic 
amplitudes are (}uite different from those obtained from a graphical 
Fourier analysis of the same oscillographic record with a consistent 
degree of care and accuracy. They also are different from the amplitudes 
obtained from the determination of a Fej^r sum which approximates 
this record with tolerances that, for the same graphical or experimental 
accuracy, cannot be detected. These differences are more marked in 
the higher harmonics, but in some cases arc noticeable in the lower 
harmonics and even in the fundamental. 

Who can say, then, that the measured harmonic amplitudes should be 
compared with those of a Fourier sum and not with those in other finite 
approximating polynomials? One may arbitrarily choose the Fourier 
sum as a standard of comparison, particularly since determination of it 
ordinarily involves far less computational labor, but the mistake should 
not be made of regarding this sum as the ‘‘ true analysis of the experi¬ 
mentally given function. 

The Fourier analysis of a graphically given function proceeds according 
to principles already discussed in Art. 2. They are now set down in a 
somewhat more detailed form. 

The given function J{x) is assumed to be i)lotted for the range 
— TT < X < TT. The first step is to decomfxise the function into its even 
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and odd components fi{x) and/ 2 (a:) respectively according to the rela¬ 


tions 80 and 81. The Fourier series for these components read 

/i {x) = ao -f- cos X + 02 cos 2x -f aa cos 3 * -(- • • • [ 283 ] 

faix) = bi sin x + ba sin 2 * -|- ^3 sin 3 * -|- • • • [ 284 ] 

and the corresponding partial sums are written 

= oo + cos « H--f a„_i cos (n — l)x [285] 

s^^\{x) = bi sin jc -f 62 sin 2* -f- • • • -1- sin nx [286] 

The problem is to determine the coefficients in these partial sums so that 

5”>„_i(x)^/i(x) [287] 

mfaix) [288] 


According to Art. 2, the range 0 < x < *• is divided into n subranges, the 
centers of which correspond to the x-values 0 < Xj < X 2 < • * • < x„ < t 
with 


i2k - l)x 
2n 


[289] 


With the cx)efficients 

ccka = cos sxk and /Ska = sin sXk [290] 


as defined by Eqs. 52 and S3, the problem reduces to a determination 
of the solution of the systems of linear algebraic equations 



n—1 

2 =/l(*fc) 

asQ 

II 

• 

• 

• 

[291] 

and 

iC “ /z (^fc) 

(^ = 1, 2, • • • ») 

[292] 

Multiplying these equations respectively by akr and pkr 

and summing 

over k yields 

rYf 

n 

«• = «*r/l(*^k) 

[293] 




and 


1 ft. = £ 0krf2(Xk) 
k-l 

[294] 


In view of the orthogonality conditions stated by Eqs. 56 and 57, one 
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finds 


and 


t -1 


n 

2^" 


[nao 


for r = 1, 2, ■ • ■ n — 1 
for r = 0 


n 


L 0krf2iXk) 

k-1 





for r = 1, 2, • ■ • « — 1 
for r = « 


Observing that 

fikn = sin nxk = sin {k - |)ir = (-1)*“^ 


and that 


0‘kQ = 1 


Eq. 295 gives 

2 " 

ar = akrji (Xk) (r = 1, 2, • • • n - 1) 
and in particular 

oo = - £ /l (Xk) 
tik-i 

whereas Eq. 296 yields 

ir = “ £ ^krf-jiXk) (r = 1, 2, • • • M - 1) 
n jt-i 


[295J 

[296] 

[297] 

[298] 

[299] 

[300] 

[301] 


with 

6n = - £ i-l)’‘~%{Xk) 

tlk^l 


[302] 


The last four equations constitute the desired solution. The values 
of/i (a-fc) and/ 2 (:fi) for ^ = 1, 2, • • • w are taken from the graphical plots 
for these functions, and the values of the coefficients atr and Bkr are either 
calculated from the relations 290 or read from graphical plots of the sine 
and cosine functions, it being noted that the arguments of these functions 
are {2k — 1 )5x/2m. Thus all the values of the coefficients akr and fikr are 
readily taken from a pair of carefully plotted curves for the sine and cosine 
functions over a 90-degree interval. In this way the solutions given by 
Eqs. 299 to 302 are quite rapidly evaluated for reasonably large values 
of n. 
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It should be observed that the values of the coefficients Ur and hr thus 
obtained, when substituted into the partial sums 285 and 286, yield func¬ 
tions which agree respectively with/i {x) and / 2 (^) at the points • Xn 
and, of course, also at the points which correspond to the negatives of 
these jc-values. Over the small ranges between these points the values of 
the partial sums do not agree with the corresponding ones of the functions 
f\{x) and /2(^), but if n is chosen sufficiently large it is reasonable to 
expect a fairly good approximation between the partial sums and the 
functions which they are to represent. 

If the functions f\{x) and f2{^) are relatively smooth, the points 
Xi ' ‘ ‘ Xn may be spaced farther apart; if the given functions are very 
irregular, the spacing of these points must be smaller. At all events the 
spacing must be sufficiently close to take account of the most rapidly 
varying portions of the given functions; otherwise such variations cannot 
be expected to be even approximately reproduced by the resulting partial 
sums. 

Of the nature of the resulting approximation not much can be said 
inasmuch as this depends largely upon the particular characteristics of 
the given function and the chosen spacing of the points • • • Xn* In order 
to conserve computational labor, this spacing is ordinarily chosen as large 
as possible, in which case the coefficients in the vicinity of the terms of 
highest order cannot be expected to be even approximately equal to the 
true Fourier coefficients. However, in view of the discussion given earlier 
in this article, it does not necessarily follow that these coefficients are 
practically of less value than the others. 

In various practical problems, methods of determining finite trigono¬ 
metric polynomials which exhibit controllable approximation properties 
wnuld be highly desirable. Of particular interest in this respect would be 
a method of determining a polynomial which approximates the given 
function with a uniform tolerance, since this type yields the closest 
approximation for a given finite number of terms. Such methods arc 
desirable not only for use with graphically given functions but also for 
analytically given ones as well. Unfortunately, these questions have as 
yet received little attention. 

16 . Relation to the Bessel functions; Sommerfeld's 

INTEGRAL 

The problem of determining the spectra of frequency or phase-modu¬ 
lated sinusoidal time functions, which occurs in the consideration of 
communication signals for which this type of modulation is used, reduces 
to the determination of the Fourier series representation for the functions 
cos (p sin x) and sin (p sin x), in which p is a j)arametcr. Since these are 
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the real and imaginary parts of the function 

/(*) = = cos (p sin *) +j sin (p sin *) [303] 

one may obtain both the desired Fourier series by considering this com¬ 
plex function alone. Incidentally, it is to be observed that this is a complex 
function of the real variable x and not a function of a complex variable. 
No extension of the Fourier series to functions of a complex variable is 
involved here, although such an extension is possible. 

The Fourier series for the function 303 is advantageously written in 
the complex form 

/(«) = f: [304] 

n * — « 


in which 


^ ^ dx [305] 

This integral is a special fonn of the more general complex integral 

Z,ip) = ^J gipcoa VP(f^/2) [-306] 

which Sommerfeld has shown* to be capable of representing cylinder 
functions of all kinds according to the specific choice made for the path 
of integration in the complex f-plane. 

For the present problem it is sufficient to observe that the form which 
the integral 306 takes for the representation of cylinder functions of the 
first kind (Bessel functions), with the order p equal to an integer w, is 
(except for a factor 14) identical with the integral 305. This function is 
usually denoted by Jnip), thus, 

«„ = A(p) = ^ [307] 

The restriction, that this integral representation for the Bessel function 
is valid only for integer values of n, is not violated in the problem of 
Fourier expansion considered here. 

Numerous variations in the form of the integral 307 are possible, a few 
of which may be worth mentioning. For example, making the change of 
variable x—*x + vf! and noting that the limits on the integral may, 
because of the periodicity of the integrand, be changed arbitrarily as long 

*Math. Ann., 47 (1896), 335. Also in Rienxann-Weber, Differenlialgleichunien der Phynk, 
Vol._II, p. 454 (Vieweg, 1927). 
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as the integration extends over the fundamental range of 2ir, one obtains 
Jn{p) = [308] 

27r «/o 

or, replacing x by —x (including dx by —dx) and noting that the limits 
become 0 to — 27r, but that 

X — 2 t po p2x 

t309] 

one may also write 

*^n(p) = ;^ [310] 

ZTTt/O 

which is the form obtained from the general integral 306.* If it is observed 
that 

^-in(W2) ^ 

this last form is seen to be expressible as 

Jnip) ^ V"* dx [312] 

Noting that 

^ip cos iginx ^ ^ip cos X ^ j^jp 008 x [-3 j 3 J 

and that the first of these two terms (as a function of :r) is even while 
the second is odd, one finds that the integration in Eq. 312, which may 
alternatively be extended over the range — tt to jt, yields nothing for 
the second term and that the result for the first term may be written 
in the form 

Jn(p) = — f cosnx dx [314] 

TT */0 

Applying a similar process of manipulation to the integral 307, in which 
the terms of 

^jiptiiax~nx) _ ^ ^ [315] 

are observed to be respectively even and odd, one finds still another 
representation which reads 

Jn(p) — ~ f cos (p sin X — nx) dx [316] 

TT «/o 

*The Bessel function Jp(p) may be expressed as Jpip) = -f-(p)] in 

which the Hankel functions //p^^^(p) and Hp^^^ip) are given by the integral 306 for particular 
paths in the f-plane, and the Bessel function Jp(p), through choosing the resultant of these 
two paths. A more detailed discussion is given in Art. 26. 
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From this form it is easily seen that /„(p) is real for real values of p. 
The form given by Eq. 314 is convenient for establishing the relation 

/_„(p) = (-!)"/„ (p) [317] 

The Fourier series representation for the function 303 is, according to 
Eqs. 304 and 307, given by 

gipirin, ^ £ /nfpV"* [318] 

na — flO 

Writing out the indicated summation, one has 

gjpsinx ^ ^ 2[72 (p) cos 2x + Jiip) COS 4* H-] _ 

= 2j[Ji (p) sin X + /aCp) sin 3x + • - • ] ^ 



8 10 11 12 IB 14 


Fig. 25. A plot showing the doseness of approximation to the Bessel function of 
order zero by the function of Eq. 322. 

Separation into real and imaginary parts yields 

COS (p sin x) = Joip) + 2 [/ 2 (p) cos 2x + Ja{p) cos 4* + • • • ] [320] 
and 

sin (p sin a:) = 2[/i (p) sin * + /sCp) sin 3a: + • • • ] [321] 

which are the desired relations. 

Regarding the numerical calculation of the coefficients in these Fourier 
series, it is useful to observe from the plots in Figs. 25 and 26 that the 
functions Jo{x) and Ji{x) are approximated sufficiently closely for 
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most engineering purposes by the expressions 


Mx) ^ 



and 



[322] 


[323] 


for values of x larger than about 4. In connection with the frequency or 
phase modulation problem the arguments of the Bessel functions are for 



Fig. 26. A plot showing the closeness of approximation to the Bessel function of 
order one by the function of Eq. 323. 


the most part at least as large as this value or much larger, so that it is 
seldom necessary to consult the tables or curves for these functions. 
The functions of higher order are readily calculated in terms of Joix) 
and Ji (x) from the recursion formula* 

2 n 

Jn+l(x) = — /n(a:) - Jn-l(x) [324] 

X 

•The derivation and discussion of this formula may be found in various well-known books 
on the subject of Bessel functions. The approximate expressions 322 and 323 are derived 
in Art. 26. 
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17 . Fourier series in terms of more than one variable 

The Fourier series representation of a periodic function may readily 
be extended to functions of more variables. For example, if f{x,y) is 
periodic in both the variables x and y with the fundamental ranges 
0 g X g 27r and 0 g y g 2ir, and if, throughout the rectangular region 
thus defined, the derivative 

Jl. 

dx dy 

is finite and continuous, the series 
f{x,y) = f 

/i, K = — w 

is absolutely and unifonnly convergent throughout the stated region 
and there represents the function/(x,y) in the Fourier sense. 

As in the case of the Fourier series for a function of a single variable, 
the derivative 325 or the function f{x,y) need not be continuous at all 
points of the region. The representation 326 is still possible as long as 
the Dirichlet conditions (see latter part of Art. 7) are satisfied in both 
the variables, but the series is then no longer unifonnly convergent 
throughout the entire fundamental region. 

The coefficients in the complex series 326 are given by the formula 

[327] 

which is a straightforward extension of the formula applying to functions 
of a single variable. Derivation of it may be assumed to proceed by con¬ 
sidering the function/(x,y), for the moment, for a particular value of y. 
That is, for y = con.stant,/(x,y) is a function of x only, and a f'cnrier 
series representation is possible in the form 

fix,y) = i: A,(y)e’>^ [328] 

— - go 

in which the coefficients 

My) = r rn^,y)e-’^^dx [329] 

Zir «/o 

are functions of the parameter y. 

For any integer value of /x, A^(y) may be represented by a Fourier 
series in the variable y, thus 

A,{y)= £ 


[326] 



[330] 
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with coeflSicients 

a^> = -^£^A,(y)e-’‘^dy [331] 

Substituting Eq. 330 into Eq. 328 yields the double sum 326, which is 
the desired expansion ior f(x,y); and substituting Eq. 329 into Eq. 331 
yields the formula 327, for the resulting Fourier coefficients. 

Thus the Fourier expansion may readily be extended to functions of 
any number of variables. 

18. Frequency groups 

In the present discussion a finite group of simple harmonic time func¬ 
tions (frequency components) is assumed to be given, and an inquiry is 
directed toward determining the nature of the function defined by linear 
superposition of them. Although this problem has much in common 
with the consideration of the properties of the partial Fourier and Fej^r 
sums discussed in Arts. 13 and 14, the present interpretations are directed 
toward an entirely different goal, namely, toward a means for represent¬ 
ing, in a closed form, functions which are not necessarily periodic yet 
for which the defining range extends over the entire region of the inde¬ 
pendent variable from minus to plus infinity. 

To begin with a simple example, it is assumed that three simple 
harmonic functions with any finite amplitudes are given, having the 
frequencies 100, 125, and 150 cycles per second. The relative phase 
angles are for the moment immaterial. The resultant function given by 
the sum of these three components is periodic, its fundamental frequency 
being 25 cycles per second. This conclusion is clear from the fact that 
25 is the highest common factor (HCF) of the group of numbers 100, 
125, and 150. The fundamental period is one-twenty-fifth of a second. 
Throughout this interval the 100 cycles per second component completes 
4 cycles, the 125 cycles per second component completes 5 cycles, and 
the 150 cycles per second component completes 6 cycles. The original 
state of affairs is then re-established because each component has com¬ 
pleted a whole number of cycles. This statement is true no matter what 
the relative phase angles of the components may be. 

In the language of the Fourier series, the resultant function is repre¬ 
sented by its fourth, fifth, and sixth harmonic components alone. All 
other components, including the fundamental, are absent. It becomes 
clear that the linear superposition of a group of simple harmonic com¬ 
ponents yields a periodic function only if their frequencies have a com¬ 
mon measure. This means that the frequencies must be given by rational 
numbers or be rational multiples of the same irrational or transcendental 
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number. If several different irrational numbers (like Vl) or trans¬ 
cendental numbers (like r or the naperian base e) are contained in the 
group of frequencies, the resultant function never exactly repeats its 
sequence of values; that is, its period is infinite. The same is true if 
rational, irrational, and transcendental numbers in any combination 
are contained, in the group of frequencies. 

For example, the function 

/(/) = cos 1(X)^ + cos (1(X) + T)t [332] 

never repeats its sequence of values. This situation should not be con¬ 
fused with the well-known circumstance that the fvmction given by 
Eq. 332 can be interpreted as a beat phenomenon through conversion 
of the right-hand side of this equation to the form 

fit) = 2 cos ^ • cos (lOO -H 0 / [333] 

which is customarily plotted through considering the slowly varying 
function 2 cos (ir/2)/as an envelope containing the rapidly varying simple 
harmonic function cos (100 -|- ir/2)/. Each half period of the function 
cos (ir/2)< is commonly referred to as the “ beat period,” but this is a true 
period only if the difference between the two frequencies involved in the 
expression 332 is at the same time their highest common factor. 

Evefi .when the two frequencies are rational numbers the beat period 
is not necessarily a true period. For example, the frequencies 100 cycles 
per second and 103 cycles per second give rise to a beat frequency of 
3 cycles per second, but the true fundamental frequency is 1 cycle per 
second. In other words, the exact pattern of the resultant function does 
not repeat until three beat periods have elapsed. The well-known experi¬ 
mental fact that the human ear (under proper circumstances) appears to 
recognize the beat frequency as though it were actually present in the 
form of a separate component is a physiological phenomenon due in 
part to a nonlinear characteristic in the response mechanism of the ear, 
and this is not to be confused with the strictly linear superposition of 
component frequencies considered here. 

It is interesting as well as instructive to generalize the problem of the 
simple beat phenomenon by inquiring how the interference pattern 
looks when more than two frequency components are superimposed. 
Incidentally, one must recognize that the familiar beat pattern in the 
case of two frequencies is pronounced only when the increment between 
these frequencies is small compared with either one. When the two 
frequencies and their difference are of the same order of magnitude, the 
conversion from the form of Eq. 332 to that of Eq. 333 is, of course, 
still valid, but the two functions whose product is represented by Eq. 
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333 then vary at about the same rate and the beat character of the result¬ 
ant function is lost. 

In generalizing the problem of the beat phenomenon it is, therefore, 
essential to assume a group of simple harmonic components whose spacing 
in the frequency spectrum is small compared with the mean frequency 

of the group. The line spectrum of 
such a group containing seven com¬ 
ponents is illustrated in Fig. 27. The 
mean angular frequency is wo- The 
adjacent frequencies are wq + wq 
— boiy wq + 2 b<j)y Wo 25a), • • * and 
so forth, their uniform spacing 
being equal to 5a). 

In general, a frequency group of 
this sort is considered to consist of 
n components, and for simplicity all the amplitudes are assumed to be 
equal and aU the phase angles zero. It is further expedient to set the 
common amplitude equal to l/«. The width of the group is defined as 

Ao) = w5a) [334] 




5a) 










J 

1 

n 

i ,, 


Wo 




Fig. 27. The line spectrum of a fre¬ 
quency group. 


The analytic expression for the group then reads 

[ cos a)o/ + cos (a)o "h 5a))/ + COS (a)o “h 25a))/ ] 

/ » - 1 \ 

+ • • • + COS I 0)0 ^-2— J i 

4“ cos (oJo — 5a))/ 4“ cos (a)o — 25a))/ 


m = U 

n 


/ «-1 \ 
+ • • • + cos (wo- 2 — I ^ 


By repeated use of the trigonometric identity 

cos (a ±.b) = cos a cos J = 1 = sin a sin b 
this expression may be put into the form 


/(0 = 


2 cos wo^ 


n 


^ + cos 5w/+cos 25w/+ 


«—1 

+COS ■■ ■ Swl 


[335] 


[336] 

[337] 


With the formula expressed by Eq. 11 this result may be written 

. n5u 
sia~i 

f(j) =--— • cos wof [338] 

» sin — / 
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Here the function 

. . 

sin — / 

f (^) =-^ [339] 

. OCt> . 

n sin— t 
2 

is slowly variable, conipared to the mean frequency component cos oqIj 
and may be regarded as an envelope function enclosing this mean fre¬ 
quency. The beat phenomenon is placed in evidence by the envelope 
function just as it is in the simple case of two interfering components. 



Fig. 28, The inttTfercnce pattern of the frequency group given in Fig. 27, 


This envelope function is plotted in Fig. 28 versus the time t for the 
case S/ = 7. The interference patteni for the group of frequencies whose 
line sjiectrum is given in Fig. 27 is thus illustrated by Fig. 28. The regions 
of constructive interference, which lie in the vicinities of the main humps 
of the envelope, are spaced at intervals of 

Tg seconds [340] 

The duration of each main hump is iir'Acc seconds. The group period 
or beat period is, according to Eq. 840, inversely proportional to the 
frequency increment 5aj, and the duration of a region of constructive 
interferenc'c is inversely proportional to the width Aoj of the group. If 
this width is kept constant while more components are added to the 
group, the regions of constructive interfcr<‘nce occur at longer interv'als 
but their duration remains the same. I'he number of smaller humps be¬ 
tween the large ones also increases; but. for a large number of component 
frequencies, the amplitudes of these smaller humps become insignificant 
midway between the large humjis and in this vicinity. 

The fact that the interval between regions of constructive interference 
is inversely proportional to the frequency increment 5 c*j leads to the con- 
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elusion that, as this increment is allowed to approach zero, the beat 
period grows without limit. The frequency group finally becomes con¬ 
tinuous, and the resulting function has only one region of constructive 
interference in the entire time scale from minus to plus infinity. This 
reasoning assumes, of course, that each frequency component in the 
group endures throughout the entire time scale; that is, it represents a 
true steady state component. 

The limiting form for the envelope function F(/), resulting from 
letting So) approach zero, is readily evaluated. Since the width Aw of the 
group remains constant, n and 5w must vary inversely as the limit 
n —>■ 00 , —»0 is carried to completion. The trigonometric sine in the 
denominator of Eq. 339 may be replaced by its argument, so that the 
limiting form of this function is readUy seen to be 

. Ab) , 
sm —/ 

m = - [341] 



This is the function discussed in Art 13 and plotted in Fig. 17, except 
that here 


n 



[342] 


The resultant group function 


m = 


/. \ 
sin —- / 

2 





COS 


[343] 


is now entirely transient in nature; that is, it never repeats, but has only 
one region of constructive interference. Beyond this region the compo¬ 
nents in the group (which are now infinite in number) interfere de¬ 
structively forever. 

Since the phase angles of all the components are chosen equal to zero, 
the region of constructive interference lies at the time origin. If in the 
argument of each cosine term in Eq. 335 a phas6 angle — ^ is inserted 
which has the following frequency dependence 

== (<o — (i>o)^o [344] 

the variable t in the above formulas for the envelope function is replaced 
by (/ — to). The region of constructive interference then occurs in the 
vicinity of the point t = to- If the phase angles of the components in the 
group are given random valves, the form of the resulting interference 
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pattern becomes very difficult to determine and in general exhibits no 
well-defined region of constructive interference. 

The fact that a continuous group of frequency components gives rise 
to a resultant function having a transient nature suggests that if a 
similar limiting process is carried out with the Fourier series, a means 
will be obtained for analytically representing an arbitrary nonperiodic 
function. This suggestion is followed in the following article- 


19. The Fourier integral 


The essence of the discussion in the preceding article may be sum¬ 
marized thus: Whereas the linear superposition of a group of discrete, 
uniformly spaced, frequency components (finite or infinite in number) 
gives rise to an interference pattern of a periodic nature, this pattern 
assumes a transient character when the frequencies in the group are 
continuously distributed. The resulting so-called continuous spectrum 
should be thought of as a line sp)ectrum in which the spacing of the lines 
is allowed to approach zero, and the transient character of the resulting 
time function may be thought of as the limiting form of a periodic func¬ 
tion for which the period has become infinite. That these two limiting 
processes are consistent is evident from the fact that the spacing of the 
lines in the spectrum of a periodic function equals its fundamental 
frequency, which is the inverse of its period. It may further be helpful in 
this connection to recognize that the period (which is the reciprocal of the 
spacing of the lines) is equal to the line density expressed as the number 
of lines per cycles per second. As the period is allowed to grow without 
limit, the line density grows without limit, so that finally the spectrum 
becomes a continuous one and the function never repeats; that is, it 
becomes a transient function. 

By the carrying out of this limiting process in terms of the Fourier 
series Eq. 175 and the relation 176 for its coefficients (spectrum function), 
an analytic means is obtained for the representation, in a closed form, 
of an arbitrary transient function. The value of such a mathematical tool 
in connection with various engineering problems is readily appreciated. 

Repeating, for convenience, the mathematical statement for the 
periodic case* 


m = £: 

n = — «> 

ZTT 


[345] 

[346] 


■"The fundamental angular frequency is in the present article denoted by wi in order that 
the symbol w may be used to denote any arbitrary angular frequency. 
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one should observe that the limiting process indicated by r—+ « or 
wi —> 0 evidently is accompanied by a„ —> 0. That is, as the line spacing 
in the spectrum is allowed to become smaller and smaller, the amplitudes 
of the harmonic components also become smaller and smaller. However, 
it may be expected that the ratio an/wi approaches a finite limiting 
function. Thus, before carrying out the limiting process, it is expedient 
to rewrite Eqs. 345 and 346 in the form 


/(/)= £ [347] 

ruai ••— CO \a)i/ 


In Eq. 347 the symbol 5(«aj]) stands for the increment in the variable 
fiwij which is equal to the line spacing and hence equal to coi. 

The limiting process is now formally indicated by 


r —> 00 


^ 0 
w —^ 00 

S(n(o) —> dev 


(na)i) 



0 ) 


[349] 


Here it should be recognized that a new variable for the frequency, a 
continuous variable, must be introduced to take the place of the dis¬ 
continuous variable ncoj. This new variable (denoted by a>) refers to any 
finite angular frequency in the continuous spectrum just as the discon¬ 
tinuous variable nwi does in the line spectrum. The introduction of the 
new symbol may be regarded as a convenient way of avoiding the ap¬ 
pearance of the quantities n and wi, which become improper in the limit. 
However, co = nwi remains a proper variable and still refers to the 
frequency of any harmonic component in the limit precisely as it does 
before this limit is carried to completion. 

If this limiting process is thought of as being carried out in steps 
through doubling and redoubling of the period r, it becomes clear that 
each time r is doubled, any specific harmonic component doubles its 
order n. If attention is fixed upon a specific harmonic frequency, n and 
6)1 must vary inversely (that is, ncji must remain constant) as the period 
is increased. The frequency increment d(ncji) in the limit is formally 
replaced by the differential du), and the ratio an/wi becomes a finite 
function gicj) of the continuous frequency variable o). This function 
expresses the variation of the harmonic amplitudes in the limit. 

It remains to recognize that as the limiting process is carried to com- 
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pletion, the summation in Eq. 347 becomes an integration. The final forms 
of the relations 347 and 348 are 


/(O = y* 

[350] 

gM = 

[351] 


This heuristic derivation of the relations 350 and 351 does not establish 
their correctness on a rigorous mathematical basis, but from an en¬ 
gineering point of view a rigorous proof may properly be omitted since 
the principal interest lies in the interpretation and use of these forms. 

It may be pointed out once more that the complex harmonic ampli¬ 
tudes are not given by ^(co) but by g(aj) iw. Since g{oj) is finite, and do> is 
the symbolic representation of a quantity which is regarded as becoming 
vanishingly small, the harmonic amplitudes are also vanishingly small. 
However, just as 5(«aji) denotes a constant spacing in the line spectrum 
of a periodic function, so dw, which represents B{no)i) as the limiting 
process is carried to completion, must, at any stage of this process, 
likewise be regarded as a constant. Hence g(o)) is proportional tog(w) do)y 
so that a plot of g(co) versus w shows the correct variation of the harmonic 
amplitudes with frequency even though all these amplitudes are vanish¬ 
ingly small. 

Equation 350 is called the Fourier integral representation for the 
function /(/). The function ^(o?) is called the Fourier transform of /(/) 
and, reciprocally, /(/) is called the inverse Fourier transform of ^(w). 
The second of the pair of integrals 350 and 351 transforms a time func¬ 
tion/(/) into its equivalent frequency function ^(oj), and the first of these 
integrals reverses the [)rocess. The second integral analyzes the time 
function into a spectrum, and the first integral synthesizes the spectrum 
to regain the time function. g{oi) represents the function in the frequency 
domain just represents the function in the time domain. One may 

also regard Eqs. 350 and 351 as representing simultaneously a pair of 
integral equations and their mutual solutions. 

The graphical interpretation of the entire process of Fourier analysis 
and synthesis in terms of the frequency spectrum as discussed in Art. 9, 
as well as the method of manipulation of the forms 350 and 351 in con¬ 
nection with various physical and mathematical problems, remains 
exactly the same as for the Fourier series. Hence there is nothing new 
to be learned in this respect. The essential difference lies only in the fact 
that the spectrum function is continuous and that the synthesis of the 
spectrum is accomplished by means of an integral instead of a sum. This 
latter difference is actually an advantage because more formulas are 
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available for the evaluation of integrals than for the evaluation of sums. 
The principal advantage, however, lies in the fact that the Fourier 
integral is capable of representing transient functions. 

The conditions under which this representation is possible are es¬ 
sentially the same as those which apply to the representation of a periodic 
function by means of a Fourier series. These are the Dirichlet conditions 
as pointed out in Art. 7. A detailed difference in the form of these condi¬ 
tions arises from the fact that the fundamental range is now infinite 
instead of being finite. In view of this difference, the condition 136 reads 

J' !/(/)[ dt shall be finite [352] 

At a discontinuity of the function /(/) the Fourier integral (like the 
Fourier series) also yields the arithmetic mean between the two im¬ 
mediately adjacent values of the function (as stated for the Fourier 
series by the relation 137). 

The approximation properties of the Fourier integral are likewise the 
same as those of the series. In order to show this, one may consider the 
integral 350 for finite limits. Thus, the function 

s{t) = dw [353] 

is the analogue of the partial sum of a Fourier series, since it represents 
the synthesis of a finite portion of the spectrum. Substituting for g(u) 
the expression given by Eq. 351, and using $ in place of the variable /, 
one has after interchanging the order of the two integrations 

[354] 

Writing for the exponential 

g—ja{e-t) _ _y sin <o($ — t) [355] 

and observing that the cosine is even while the sine is odd, one finds that 

^ 2 cos to (<? - 0 dto [356] 

and hence that Eq. 354 may be written 

sii) = - f fio) de /**cos — t) du [357] 

TT */— • vO 

But 

r ,. ,,, , sin a(0 — t) 

cos u{6 — t) du = -- r - 

(fi -1) 


[358] 
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SO that 




'' (d-t) 

which is analogous to the integral 245 for the partial sum of a Fourier 
series. 

In order to illustrate the application of this formula one may consider 
the function defined by 

m =0 for 0 < - ^ 


fie) = 1 for - I < 0 < I 


fie) = 0 for 0 > - 


Then the integral 3vS9 yields 


1 sin ~ /) 


f(0 = - / 


{e - /) 


which may be written 


1 ra(H 2 -t) sin u 

KO = - / — 

TT J~ai6}2-\-t) U 


or 


1 «)sm w , 1 sm w , 

s{t) = - I - du -/ -- du 

TT Jo u TT Jo u 



Utilizing the definition of the ^i-fiinction according to Eq. 257, and 
observing that Si {—x) = —Si (x), one obtains the result 

5(/) = I |5i a ^/ + 0 - Si a - 0| [364] 


Figure 29 shows a plot of this result for the choice a = 167r/5. The 
separate ^f-functions are also drawn (dotted) in order to illustrate more 
clearly how the resultant function is obtained. The similarity is very 
evident between this result and that shown in Fig. 21 for the partial sum 
of a Fourier series representing the periodic repetition of the present 
function /(0). In fact, the approximate evaluation of the Fourier sum 
s„ix) for large values of n given in Art. 13 in connection with the problem 
illustrated in Fig. 21 likewise leads to an expression in terms of the 
5i-function. 
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The characteristic 18 per cent overswing at the points of discontinuity, 
yielding in the limit a w the Gibbs phenomenon, is again in evidence, 
just as it is for the Fourier series. Equation 364 and the corresponding 
plot in Fig. 29 also illustrate the fact that the value of the h’ourier integral 
at the points I = ±5/2 equals the arithmetic mean between the two 
values of the function immediately adjacent to these points of 
discontinuity. 



Fig. 29. The Gibbs phenomenon and the arithmetic mean property are characteristic 
of the Fourier integral as well as of the series. 

20. Alternative forms in which the Fourier integrals may 
BE written 

The pair of mutually inverse integral relations 350 and 351 may be 
written in a variety of different forms, with some of wFich it is well to 
be acquainted. One of the astonishing features about these relations is 
their almost complete identity in form. Thus, the integral 351, except 
for an interchange of the variables, w and /, differs from the integral 350 
only in the appearance of the factor l/2x and the reversed algebraic 
sign in the exponent of e. The first of these differences may be removed, 
if removal seems desirable, by redefinition of the transform oi fit) as 

g*(to) = \^g{ci) [365] 

The relations 350 and 351 then assume the more symmetrical forms 

fit) = g* („) dec e’‘“‘ [366] 

f(cc) = -}= f^f(t)dle-^'‘^‘ 

A / 9^ */— 60 


[ 367 ] 
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Alternatively, the appearance of a factor before these integrals may 
be entirely avoided through considering the transform to be a function 
of the cyclic frequency / (in cycles per second) instead of the angular 
frequency w = ItJ. Inasmuch as du = 2% df, it is readily seen that when 

!(/) = 2T^(a.) [368] 

the integrals 350 and 351 become respectively* 

[369] 

t/ - eo 

and 

k(f) — f h{t) di [-570] 

U — 00 


21. Special forms for the Fourier integrals when the given 
FUNCTION is even OR ODD 

If the Fourier integrals 350 and 351 are written in the more explicit form 
/(O = f g(w) (cos w/+y sin w/} dw [371] 

ty— 00 


and 


1 

gM = / f{i){coswl —ysiiio)/} dt [372] 

Ztt •/— «> 

then, if f{l) is an even function of t, the second term in the integrand of 
372 contributes nothing to the value of this integral, and if /(/) is an odd 
function of the first term contributes nothing. In the first of these cases, 
moreover, g(a)) must be an even function of w since the cosine is an even 
function, and in the second case, ^(ce) is an odd function because the 
variable oj is then contiiined only in the argument of the sine. Hence it 
follows that if /(/) is even, g(a)) is also even, and the Fourier integrals 
read 


= X 

<Q 

g(a}) cos o)t do 9 

• 80 

[373] 

*(») - i 

J* f{t)co?,<aldt 

[374] 


*A different symbol is used here to denote the time function in order to avoid confusion 
with the symbol / used for the cyclic frequency. 
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If /(i) is odd, g(u) is also odd, and the Fourier integrals have the form 


f(0 = j f g («) sin ut doi 

%J - 00 

[375] 

1 


[376] 


In both these cases the integration may alternately be extended over 
the range 0 to <» and the integrals multiplied by 2. This factor of 2 may, 
if desired, be absorbed by the function g(a>) in the integrals 373 and 375, 
whence the factors for the integrals 374 and 376 become I/jt instead of 
l/2ir. The factory appearing in the forms 375 and 376 evidently need 
not appear if the transform of/(/) for this case is defined as Jg(u) and 
is denoted by a single symbol. 

These results show that if the given function/(/) is real (although 
this is usually the case in [)ractice, the validity of the Fourier integrals 
does not require it), g(o 3 ) is real when/(/) is even, and purely imaginary 
when/(/) is odd. In general, for real functions /(/), one may decompose 
this function into its even and odd components/i (l) and/ 2 (/) respectively, 
according to the relations 80 and 81, and then have for the corresponding 
transform 

g(w) = gi(w) +Jg2(‘^) [377] 

in which 

gi («) = £ f ji (0 dt = £ J£ fy it) cos dt [378] 

and 

g 2 (") = = - £j^^f 2(0 sin utdt [379] 

22. Some elementary properties of the Fourier transforms 

In the Fourier integrals 3.50 and 351, if the algebraic signs of both 
variables u and t are reversed (a; replaced by —co and / by —t), the forms 
of these integrals remain unchanged except for the appearance oi f{—t) 
in place of f{t) and g(—w) in place of g{w). To see this, one should note 
first that changing the signs of both co and t leaves the exponents of e 
unchanged; and, second, that the signs of dw and dt do change but so 
do the signs of the infinite limits, and since this amounts to an inter¬ 
change of the limits, the resulting signs of the integrals are the same as 
before. Hence, one obtains the result: 

If g(c<)) is the transform of f(t), then 
g( —w) is the transform of f( —t) 


[380] 
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In the general case in which both /(/) and g(w) may be complex, it 
should be observed that both sides of Eqs. 350 and 351 assume their 
conjugate values if the functions /(<) and g(uj) are replaced by their 
conjugate values/(<) and g(u), and if, in addition, the algebraic sign of 
either w or / (not of both) is changed. This change is equivalent to chang¬ 
ing the sign of j in the exponent of e. The statement, therefore, follows 
that: 

g(") w the transform of f(t), then rt«n 

g(=Fw) is the transform of f(±t) ■* 

As pointed out in Art. 20, the integral 350, which performs the inverse 
of the transformation given by the integral 351, is almost identical to 
the latter in form. If it were identical in form, one could omit entirely 
the distinction between the transform and the inverse transform of 
a given function, since two successive applications of the same trans¬ 
formation would yield the function itself. That is, the variables co and t 
might be interchanged, or in other words /(/) and g(w) might be regarded 
as each other’s transform. 

Although the actual situation is not quite so simple as this, it may be 
observed that the forms of the two integrals do become interchanged if 
(a) Eq. 351 is multiplied by 27r, <Jb) the integral 350 is multiplied by 
1/2t and the function g(to) under this integral sign by 2ir, and (c) the 
algebraic sign of either w or / is reversed. One may then interchange the 
variables « and / and regard g as the given function and / as its transform 
or equivalent frequency function. This conclusion is siunmarized by 
the statement: 

7 / g(«) is the transform of f(t), then r^«9T 

f(±w) is the transform of 2Tg(=F/) ^ ^ 

In particular, if f{t) is even so that g{m) is even also, the process of 
changing the algebraic sign of either w or f may be omitted. It is then 
true that if g(to) is the transform of /(/), one may reciprocally regard 
2 jrg as a given function of time and have / represent the corresponding 
frequency function. 

The statement 382 may be given an even simpler form if it is made in 
terms of the functions/(0 and g*(w) defined by the integrals 366 and 367, 
or in terms of the functions h(Jt) and g{f) defined by the integrals 369 and 
370. The factor 2ir then does not mar the almost complete reciprocity 
existing between the pair of functions involved in the statement. 

Some problems make it convenient or necessary to change the time 
scale for the given function/(/) by some factor; it is then desirable to 
know the effect of this change on the corresponding transform. In order 
to see the effect, one replaces the variable t in the integral of Eq. 351 by 
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at. As a result, the differential dt becomes replaced by a times dt and the 
exponent of e becomes —jwal. If now one replaces co by o)/a, there results 

Hence it follows that: 


If g(o)) is the transform of f (t), then 



is the transform of f(at) 


[384] 


This statement is true only if the factor a is positive. For example, 
for a = — 1 the statement 384 is evidently incorrect because it conflicts 
with the statement 380. This conflict arises because the algebraic signs of 
the limits change when a is replaced by —a. 

Another useful result follows from the observation that if the function 
/(/) in the integral 351 is replaced by the product/(f) • and the 

two exponentials in the resulting integrand are combined into one 
exponential with the exponent —/ (w wo)f, the effect upon the function 
g is merely to replace its independent variable co by (to T Wo). Hence: 

If g(w) is the transform of f(t), then r38'?l 

g(w =F Wo) is the transform of f (t) • ^ 

The latter function is the complex form of a sinusoidal function of 
angular frequency wo whose amplitude is modulated by the function/(/)• 
The corresponding spectrum function is seen to be the same as that for 
/(/) except for a translation equal to the value of wo- Utilizing this result 
together with the principle of linear superposition, one may readily obtain 
the spectrum functions corresponding to /{/) • cos u^t or / {t) ■ sin wo<. 

The complement to the statement 385 is obtained through assuming 
the function g(co) in the integral 350 to be replaced by g(w)e"‘^^"‘®. Again 
combining the exponentials, one finds that: 


If g(&)) is the transform of i{i), then 
g(w) • is the transform 0 / f (t ± to) 


[386] 


This result was observed in connection with the Fourier series in Art. 4, 
namely, that a displacement of the time function merely amounts to 
adding increments to the harmonic phase angles which are linearly 
proportional to the respective harmonic frequencies. 

Other useful relationships between the transforms are found through 
observing that it is permissible to differentiate or integrate with respect 
to the parameter contained in the integrand of either of the integrals 
350 or 351 as long as the resulting functions involved in these expressions 
still fulfill the conditions for Fourier integral representation. For example, 
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differentiating both sides of Eq. 350 with respect to t yields 


dt 


J" d(j» 


Repeating the process n times, one finds 

/»)(/)= /*“ 
t/-00 


[387] 


[388] 


from which one may conclude that: 

UsM ^ transform of f (<), then (;■«)“§(«) 
is the transform of the nth derivative of f(t) 


[389] 


The function given by this «th derivative of / {t) must, of course, still 
fulfill the requirements for which its representation by means of the 
Fourier integral is valid. If the function given by the integral of /(/), 
namely, 

P(fi) = Jm dd [390] 


also fulfills these conditions, then since 

-/«) 

it may be inferred from the statement 389 that: 

If g(aj) is the transform of f(t), then 

g(«)/jc»> is the transform of f f {$) d^ 

t/- 00 


[391] 


[392] 


Under the same conditions, this statement may be extended to fxmctions 
formed by successive integrations of/(f)- 

Similarly, by differentiating or integrating Eq. 351 with respect to w, 
one finds that: 


If g(«) is the transform of f(t), then the nth 
derivative of giu) is the transform of jt)“f (t) 


[393] 


or: 


If g(w) is the transform of f(t), then 


f" g(ji) dmisthetransformof i{t)/—}t 


[394] 


Agsun, the functions {—jt)”f{t) and f(t)/—ft must still fulfill the condi¬ 
tions for Fourier integral representation.* 

*The conditions under which the statements 389, 392, 393, and 394 are valid are actually 
far less rigid the Dirichlct conditions provided one interprets the results in the light 
of Alt* 24* 
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23. The transform of a product and the interpretation of 

POWER PRODUCTS AND EFFECTIVE VALUES FOR TRANSIENT 
FUNCTIONS 


When the g^ven function f{t) is expressed as 
component functions as 

m =/i(/)/2(/) 

a product of two 

[395] 

one is interested to know how the transform may be expressed in terms 
of the individual transforms of the components/i(0 and/ 2 (/). 

It is helpful'to observe that this problem is very similar to that of 
determining the expression for the coefficients in the resultant series 

y - yiVz = L ttrz’' 

[396] 

in terms of the coefficients in the component series 


00 

yi = L OmZ”* 

HI ^^ 

[397] 

and 


II 

8 

[398] 

Forming the product of these two series, one has 


y = L i 

n*—“flO 

[399] 

or, letting 

m n — r 

one may write this as 

[400] 

y = Z { E Ombr-m) Z' 

r *» — "0 \m * — 00 / 

[401] 

in which the substitution of the summation index r for n is permissible 
since the summation over m is independent of that over w. A comparison 
of Eqs. 396 and 401 reveals that the desired relationship reads 

00 

~ Z ^mbr—m 

[402] 

Similarly, if 


/i(0 = f gi{M’)dne^'^ 

fj -80 

[403] 

and 


f 2 (.i) = dv 

[404] 
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are the Fourier integral representations for the component time functions 
in Eq. 395, one may write 

x:x: [405] 

since /t and y are completely independent variables. 

It is now possible to make the change of variable 

V = (j) — jjl; dy = du [406] 

because a* is a constant parameter as far as the integration On v is con¬ 
cerned in Eq. 405. 

Equation 405 then becomes 

~ S~. ~ dtxe’'^‘ [407] 

If this is written 

/(O = [408] 

the transform of f{t) is seen to be given by 

g(«) = f - m) rf/i [409] 

w'hich is the desired relation. It is entirely analogous to the result ex¬ 
pressed by Eq. 402 for the corresponding problem in terms of series. 

Since there is no need for distinguishing between the functions fi(t) 
and fiil) in this argument, it is evident that Eq. 409 remains true if the 
subscripts 1 and 2 are interchanged. 

In an exactly analogous fashion one finds that if 


s.W - 

— ao 

[410] 

and 



&<") - hJ 

("’Mr) 

— w 

[411] 

then the inverse transform of the function 


g(«) = gi(«)S2(w) 


[412] 
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is given by* 

/(O = [413] 

Here, also, the subscripts 1 and 2 may be interchanged. 

Expressing/(0 in this last result in tenns of its Fourier integral, one has 

f [ gi Mg2 (.<») dw ^ XI it -8) do [414] 

Setting i = 0 jind subsequently substituting the s)Tnbol < for in the 
integral on the right of Eq. 414 yield the result 

J_jiit)f 2 i^t) dt = 2ir J^^gii(jn)g2i3=a)da [415] 

in which the statement 380 is also used. 

This relation is analogous to the result stated for the Fourier series 
by Eqs. 190 and 196, in Art. 10. In other words, the left-hand side of 
Eq. 415 may represent the integrated power product for some physical 
system, whence the right-hand side expresses this integrated power in 
terms of the transforms corresponding to the given time functions. The 
relation 415 is applicable to transient functions in the same way that 
Eqs. 190 and 196 are to periodic fimctions. 

If, in particular. 


? 

II 

-H 

[416] 

then, according to the statement 381 


g2(=Fw) = gl(±«) 

[417] 

or 


g2(±") = gl(=F«) 

[418] 

The relation 415 for this special case reads 


X« = 2jrX^ \gii<^)\‘da 

[419] 


which for transient time functions expresses an analogous relation to 
that stated by Eqs. 200 and 201 for periodic functions. The square root 
of the value given by Eq. 419 may be called the effective value of the 
transient time function. According to the definition of the effective 
value of a periodic function, one forms the square root of the mean of 
the integrated squared values of that function over a period. The interpre- 

*The mathematical procedure described by this integral is called " convolution ” (in the 
German literature the term used is “ faltung ”)• 
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tation of the relation 419 offers a complete parallelism between the 
periodic and the transient cases. 

Finally, it is pxjssible to form another relationship which at times 
becomes practically useful. In Eq. 415,/2 (=f 0 is any time function, and 
g 2 (±«) is its transform with the reversed algebraic signs of its inde¬ 
pendent variable. If the time function is chosen to be 2irg2(=F0. then, 
according to the statement 382, its transform with reversed signs of its 
variable is / 2 (t“)- Since the corresponding signs of the variables t and 
w are now alike, the t signs may be dropped, and one has in place of 
Eq. 415, 

(0 (")/2(") du> [420] 

In connection with this relation it should be carefully observed that 
the functions and g 2 are understood to be the Fourier transforms of 
the functions /i and f- 2 , and the latter are the inverse transforms of 
and g 2 . The reason for this emphasis is that the reader may make the 
mistake of regarding/a (w) as the transform of g^it) because the latter is 
written as a function of t and the former as a function of w. This con¬ 
fusion may best be avoided through adopting an entirely different symbol 
for the independent variable, and using the same symbol for both inte¬ 
grations since the distinction between given function and transform is 
expressed respectively by the symbols / and g, and has nothing to do 
with the symbols used for the independent variable or variable of inte¬ 
gration. The preferable form of Eq. 420, therefore, reads 

dx = gi{x)f 2 {x) dx [421] 

24. Some illustrative examples; the singularity functions 

The first function to be considered is defined by 
/(/) = 0, for / < 0 

/(/) = for / > 0 

This function is illustrated in Fig. 30. According to Eq. 351 its transform 
is given by the integral 

^X" ^ [423] 

which yields 

1 
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This result may be written 


gC") = gi(“) +ig2(‘») 


27r(a'^ 03^) ^ 2ir{a^ + w*) 



Fig. 30. An approximation to 
the unit step by a decaying 
exponential. 


According to the relations 377,378, and 
379, these arc the transforms of the even 
and odd components respectively of the 


function /(/). The odd components are shown plotted in parts (a) and 
(b) of Fig. 31. Both these comjx>nents are given by for / > 0, 


but flit) is symmetrical about the vertical axis at the origin, whereas 



(a) (b) 

Fig. 31. Even and odd components of the function of Fig. 30. 


/ 2 (/) is antisymmetrical. The results given by Eqs. 426 and 427 may 
alternatively be obtained from the integrals 37S and 379 respectively. 
Since the integrands in these integrals are even functions, the same 
value is obtained if the integration is extended only over the range 0 
to oo and the result multiplied by 2. Thus it must be true that 



cos (j)t (It 


a 

2ir{a^ + u^) 


[428] 



which, incidentally, is a simple way of evaluating these two particular 
integrals (the usual process requires two successive integrations by parts). 
These functions are shown plotted versus the ratio u/a in Fig. 32. 
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Hence the point unity, for example, corresponds to = a, so that, as a 
is given smaller and smaller values, this point corresponds to smaller 
and smaller values of <o. At the same time it should be observed that the 
ordinates of these curves are inversely proportional to a. As a is assumed 
to become smaller, the function gi(w) appears to become more peaked, 
until in the limit a —> 0 it degenerates into a single infinite ordinate at 
« = 0, and is zero everywhere else. 



Fig. 32. The transforms of the even and odd parts given in Fig. 31. 

It should be observ'ed, however, that the area under the curve gi(«) 
is constant and independent of a, for it represents, according to the 
Fourier integral 350, the value of fi {t) for I = 0, that is, 

/i(0)= = ^ [430] 

As a becomes smaller this area becomes more and more concentrated in 
the immediate vicinity of the point w = 0, until in the limit a —> 0 it is 
contained within a region of vanishing width at the origin. Since the area 
remains finite, the ordinate of gi(a)) at w = 0 must clearly become 
infinite in this limit. It is quite significant that the function gifw), there¬ 
fore, does not vanish for a = 0, as one might at first glance conclude by 
inspection of the function 426. 

From Eq. 427 it is, on the other hand, easily seen that 

limit [g 2 («)] = [431] 

„__»0 

This is the equation of a rectangular hyperbola. The manner in which 
this limiting function is approached by g 2 (“) a is assumed to become 
smaller and smaller is readily visualized from an inspection of Fig. 32. 

Turning now to the given function /(/), one sees that in the limit 
a 0 this function is zero for f < 0 and equal to the constant value 
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unity for / > 0. In Fig. 30, the curve for / > 0 then no longer falls off 
with increasing time but maintains the ordinate at / = 0 for all positive 
values of /. The limiting forms of the even and odd components shown in 
Fig. 31 are also readily visualized./i(/) reduces to the constant /2(0 
equals the constant value — for / < 0, equals the constant value +3^ 
for i > 0, and retains the discontinuity of unit magnitude at ^ = 0. 

This limiting function, defined by the relations 422 for a = 0, actually 
does not possess a Fourier integral representation, for it no longer fulfills 
the condition 352. As long as a has a nonzero value, however, no matter 
how small, the Fourier representation is possible, and hence, for a proper 
interpretation of the limiting forms of the functions g\{o)) and g 2 (w), 
such a representation may be said to be possible even in the limit a = 0. 

With the use of Eqs. 373 and 375 one has 

/(/) = J gi(w) cos ujtdo) — g 2 M sin a?/ dco [432] 

According to the preceding discussion of the function gi(a)), it is clear 
that as a becomes very small, the total contribution to the first of these 
two integrals is due almost entirely to the values of the integrand in the 
immediate vicinity of the point w = 0. If the variable t is for the moment 
assumed to remain finite, then for a sufficiently small value of a, the 
function cos w/ remains equal to unity over that small range in the 
vicinity of w = 0 which contributes almost wholly to the value of this 
first integral. In the limit a 0 this reasoning becomes exact, and in 
view of Eq. 430 one may, therefore, conclude that in or near this limit 
Eq. 432 is equivalent to 

1 


Substituting the limiting value of the function g 2 (w), as expressed by 
Eq. 431, one has 


which may be written 


According to the discussion of the 5f-function in Art. 13, and with the 
help of Eq. 257 the last result may be written, 


Sin wt 

dud 

Ud 

[434] 

u J 

[435] 


fit) = ^ + limit { - Si (a/)l 

2 It J 


[ 436 ] 
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Hence it is clear that, except for the Gibbs phenomenon at the point of 
discontinuity, the Fourier integral representation for this function is 
valid even in the limit a = 0, provided the integrals are properly 
interpreted. 

It should be observed that one cannot simply set a equal to zero in 
the expression 424 for the transform of/(/), for then g(w) becomes iden¬ 
tical withy^ 2 (w), and gi (co), which contributes the value H to the Fourier 
integral representation, is lost entirely. As long as a is retained as a 
small quantity, and discarded only after the proper interpretation of 
the various steps in the process of evaluation, no difficulties are en¬ 
countered. 

In order to illustrate this point from a slightly different angle, one may 
substitute the value 424 for g(o)) into the Fourier integral 350 and have 



—;—r“ dw 

a + JO) 


[437] 


With the sine and cosine equivalent of the exponential function, this is 

sin o)t 




do) 


[438] 


The second of these two integrals remains proper in the limit a —> 0, and 
hence one may set a = 0 in the second term of Eq. 438 without further 
ado. This term is then the same as the second term in Eq. 434, and hence 
it is evident that the first term in Eq. 438 is supposed to yield the value 
The integral in this term, however, becomes improper in the limit a —> 0 
because the integrand then becomes infinite for w = 0. If, nevertheless, 
a is set equal to zero, one observes that the integrand is an odd function 
of CO, and since the limits of integration are symmetrical, the value of the 
integral, except for the difficulty in the vicinity of co = 0, should be zero. 
In other words, whatever value this integral may have must certainly 
be contributed by the immediate vicinity of the point co = 0. For this 
vicinity, which may be denoted by — p < co < p, one may again set 
cos (j)t equal to unity (since for very small increments from co = 0, cos co/ 
differs from unity by a small quantity of the second order) and have 
for the first term of Eq. 438 


27r 



do) 

a +jo) 




-I 

2*7 L « ~ JPJa->0 


[439] 


which is the correct value. However, the importance of retaining a up to 
the last step during this evaluation process should be noted. Until then, 
a plays an important role toward guiding the evaluation and preventing 
misinterpretations; after this step has been taken, a has served its pur¬ 
pose and may be retired without causing further difficulties. 
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The integration in Eq. 439 may be understood clearly if it is regarded 
as an integration in the complex plane. Thus, when 


f = « + Jw 


this integral takes the form 


'(<»+*) 


T-pIane 

-(O'+Jfi) 

path of 


1 

2Tlj f 


[440] 


[441] 


integration 






Fig. 33. The path of 
integration for the in¬ 
tegral of Eq. 441 rele¬ 
vant to obtaining the 
unit step from its trans¬ 
form by the inverse 
Fourier integral. 


The sketch in Fig. 33 indicates the path of in¬ 
tegration in the complex f-plane. Inasmuch as the 
quantities (a +jf>) and (a — jp) have the same 
magnitude, it is clear from the discussion of the 
logarithm function in Art. 17 of the preceding 
chapter that the value of the integral 441, the 
factor l/2vj being omitted, is a pure imagi¬ 
nary quantity, equal in magnitude to the differ¬ 
ence between the angle of (a + jp) and that of 
(a — jp)- This net angle clearly approaches the 
value tr as a is allowed to become zero, but it is 
to be noted that if a is set equal to zero to start 
with, the path of integration lies upon the imagi¬ 
nary axis in the f-plane, and the net angle might 
equally well be regarded as given by — tt. With 


a retained, this ambiguity is avoided, and as soon as the correct interpre¬ 
tation has been seen, a may be discarded. 

The second example to be considered is the function defined by 


[442] 


This is the same function which is considered in Art. 19 in the discussion 
of the approximation properties of the Fourier integral, as illustrated by 
the plot of Fig. 29. The transform, according to Eq. 351, is given by 


1! 

o 

for 

'<-1 

m = 1, 

for 


m = 0, 

for 



1 5 


/. a\ 

sin CO - 
2 


V 


& 

“2 


[ 443 ] 
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The simUarity of this result to that given by Eq. 187 for the complex 
Fourier coefficients in the series representation of the function illustrated 
in Fig. 12 should be noted. Inasmuch as the latter represents the periodic 
repetition of the function considered at present, this similarity between 
the expression for the Fourier coefficients on the one hand, and the 
Fourier transform on the other is, of course, not surprising. It may be well 
to point out here that the s)Tnbol w in Eq. 187 represents tht fundamental 
angular frequency, and hence the quantity in that equation (not 
just u) becomes the analogue of «in Eq. 443. The latter may be obtained 
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Fig. 34. The rectangular pulse of unit height and its associated Fourier transform. 


from Eq. 187 through writing wi for w, and then applying the limiting 
process indicated in the expressions 349. With reference to Fig. 12, this 
process leaves the rectangular pulse at the origin but causes the adjacent 
pulses to move to infinity, thus yielding in the limit the function defined 
by the statement 442. 

The transform ^(to) as a function of « evidently has the appearance of 
the dotted curve of Fig. 13, showing the form of a„ as a function of nw. 
The important difference in the present example is the fact that the 
spectrum function g(ai) is continuous; that is, all frequencies are present, 
not just integer multiples of a fundamental frequency. Figure 34 shows 
both the time function/(<) and the corresponding transform or spectrum 
function g(w). This spectrum is a continuous one, whereas the spectrum 
shown in Fig. 13 is a line spectrum. It should be remembered, of course, 
that the amplitudes of g(u) are not the harmonic amplitudes. The latter 
are all vanishingly small since their magnitudes are symbolically indi¬ 
cated by the differential notation gCw) du. The function g(<i>), neverthe¬ 
less, shows how these amplitudes vary with u for any increment du 
however small. This is true because, at any stage in the limiting process 
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indicated by the expressions 349, the differential spacing du of the 
“ lines ” in the continuous spectrum is constant, just as the finite spacing 
wi (w in Eq. 187) is in the corresponding periodic case. 

In view of the statement 382 it is useful to observe that if the scale of 
ordinates in the plot of g(u) in Fig. 34 is multiplied by 2w, the variables 
o and i for these plots may be interchanged. That is, 2irg(0 may be 
regarded as the given time function and/fw) as its transform. There is no 
need to reverse the algebraic sign of one of the interchanged variables 
ci) or / in this example, because the functions are even. Thus, a time 
function like the curve for g(<o) in Fig. 34 is seen to have a spectrum like 
the curve for /(I). This spectrum is, of course, also a contmuous one, but 
the interesting feature about it is its finite extent. 



Fig. 35. A modulated cosine wave and its associated transform. 


This result may be predicted on the basis of the discussion in Art. 18 
regarding the resultant interference pattern of a frequency group. It is 
pointed out there that the frequency group of P'ig. 27 has an envelope 
function like that plotted in Fig. 28 and expressed analytically by Eq. 
339. As more and more lines are added to this frequency group, until it 
becomes a contmuous spectrum of finite width like the function f(t) in 
Fig. 34, the envelope function of the corresponding interference pattern 
approaches the form given by Eq. 341, which when plotted has the 
appearance of g(w) in Fig. 34. In other words, the function /(() in Fig. 34, 
regarded as a spectrum function, is a continuous frequency group whose 
resultant interference pattern (time function) has the appearance of the 
function g(w) in Fig. 34. 

By means of the statement 385 it is a simple matter to determine the 
spectrum function which results when the time function of Fig. 34 is used 
to modulate the amplitude of a sinusoidal function of arbitrary frequency. 
Figure 35 illustrates such a time function, namely, a cosine function 
enclosed by a rectangular pulse. The same figure also shows the corre- 
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spending transform, which consists of the linear superposition of the 
functions g{u — wo) and ^(w + wo). These are obtained through multiply¬ 
ing the function g(w) of Fig. 34 by Yi and displacing it respectively to the 
right and to the left of the origin by the amount wo, which is the angular 
frequency of the time function within the interval —5/2 < t < 8/2. 

It is interesting to consider the way in which the spectrum function 
for this example changes as the duration 5 of the sinusoidal time function 
is increased. One should observe that the functions g(w — wo) and 
g(w -f Wo) consist essentially of a large hump whose amplitude is propor¬ 
tional to 5 and whose width at the base of this large hump is inversely 
proportional to 5. As 5 becomes very large, the spectnun function of 
Fig. 35 assumes the form of two very tall slim humps, one at wo and the 
other at — wo. In the limit 5 —^ the spectrum function is given by two 
lines at the points dbwo, as one should expect from the fact that the single 
frequency wq alone then characterizes the resulting time function. 

A type of function very useful practically is readily derived from the 
function /(/) in Fig. 34. If the amplitude of this function is set equal to 
1/5 instead of unity, the area enclosed by the rectangle equals unity no 
matter what 5 may be. For a large value of 5, the rectangle is long and low, 
for a small value of 5, it becomes thin and tall. The transform g(w) 
corresponding to this /(/) is given by the expression 443 divided by 5, 
that is, by 


?(") = 


1 





2 / 


[444] 


If 5 is now allowed to approach zero, /(/) degenerates into a single 
infinite ordinate at f = 0; that is, the rectangle has zero width and an 
infinite height but still encloses unit area. This limiting form of the 
function / (t) of Fig. 34 is called a unit impulse and may be denoted by 
Mo(f). Its transform is given by the expression 444 for the limit 5 —> 0. 
With this limiting value of the transform denoted by j»(w), it is readily 
seen that 

t»(w) = ^ [445] 

ZTT 


In other words, the transform of the unit impulse is a constant. 

In view of the preceding discussion of the function gi(w) of Fig. 32 
for the limiting process a —»0, this result may be arrived at in a different 
manner. The inverse transform of gi(w), namely/i(/) of Fig. 31, becomes 
equal to the constant Yz for a-»0; gi(w) degenerates into a single 
infinite ordinate at w = 0, although the area enclosed by the curve for 
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gi(«) remains constant and equal to According to the statement 382, 
the transform of 2vgi (i) in the limit a —» 0 is the constant Hence the 
transform of 2gi (/) for a —> 0, which is an impulse enclosing unit area, 
is the constant l/2x, the same as v(u). In other words, the function 
2gi (0 for the limit a —»0 may be identified with the unit impulse uo(t), 
and its transform may be identified with »((i>) in Eq. 445. It is rather 
interesting that this conclusion should be true, in view of the fact that 
uo(0, in the argument of the preceding paragraph, is approached by the 
rectangular pulse/(/) in Fig. .34, and the limiting form of 2gi(t) is ap¬ 
proached by the rounded pulse of Fig. 32. 

The fact that' the transform of the unit impulse is constant and equal 
to l/2ir may also be seen graphically. With reference to Fig. 34, if /(/) 
is multiplied by 1/5, then g(w) is multiplied by 1/5 also. Its amplitude 
is then independent of 5. As 5 becomes smaller, the distance from the 
origin, w = 0, to the points « = ±27r/5 becomes larger. For a very small 
5 (tall narrow rectangular pulse) this distance is so large that, over a wide 
range of frequencies, g(w) drops off very little from its value of l/2ir at 
0 ) — 0. Finally, as 5 approaches zero, the points a = ±27r/S move to 
infinity, and the curve for g(u) becomes a horizontal line l/2ir units above 
the co-axis. 

Conversely, one may let g(u) in Fig. 34 approach the unit impulse. 
The area under this curve already equals unity because it represents the 
value of /(O), according to the Fourier integral 350. Making use of the 
statement 382 again by saying that (l/27r)/(a.’) is the transform of g((), 
and this time letting 5 approach infinity, one finds that g(() approaches 
Uo(l), and (l/27r)/( co) approaches the constant l/2ir. 

The next function to be considered is showm in Fig. 36. This is the 
integral form — m to 1 of the function/(/) in Fig. 34 multiplied by 1/6. 
Since the transform of the latter is given by Eq. 444, it follows from the 
statement 392 that the transform of the present time function is given by 


g(o}) = 


/ . 

sin (0 - ' 
2 


271^01 


V 2 / 


[446] 


For small values of w this transform behaves like the g(cj) of Eq. 424 
for a = 0, that is, like the transform of the time function defined by the 
relations 422 for a = 0. In other words, the transform 446 for the function 
illustrated in Fig. 36 has a nonintegrable infmity at w = 0. This is due 
to the fact that the present time function does not fulfill the condition 
352, and the same difficulty occurs as discussed in connection with the 
function defined by the relations 422 for a = 0. Since the method of 
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dealing with this difficulty is now understood, however, the transform 
given by Eq. 446 may be accepted as an integrable function. 

As 6 is now allowed to approach zero, the function of Fig. 36 assumes 
the form shown in Fig. 37. This form, however, is the same as that of the 
function defined by the relations 422 and illustrated in Fig. 30 for the 
limit a —♦ 0, as is also evident from the fact that the transform 446 for 
5 —♦ 0 becomes identical with the transform 424 for a —+ 0. As indicated 
in Fig. 37, this limiting form of the function of Fig. 36 is denoted by the 
symbol «_i (t). 



Fig. 36. The integral of a rec- Fig. 37. The function of 

tangular pulse similar to that of Fig. 36 where S is aUowed 

Fig. 34. to approach zero. 


Since the function of Fig. 36 is the integral from — » to / of the 
1/5-multiplied time function of Fig. 34 for any value of 5 however small, 
one may regard the function of Fig. 37 as representing the integral of the 
unit impulse «o(0' Symbolically this fact is expressed by 

«-i(0 = L «o(0 dt [447] 


in which the function «_i (/) is called the unit step function or, more 
briefly, the unit step. It is defined by the relations 


= 0, for / < 0 

M_i(/) = 1, for / > 0 


[448] 


and hence is identical with the function defined by the relations 422 for 
a = 0. It plays an important part in the Heaviside Operational Calculus, 
but in the more recent expositions of this subject the unit impulse func¬ 
tion Mo(0 is found to be of greater value, chiefly because its transform is a 
constant. 

From these discussions it becomes clear that the unit impulse may 
alternatively be expressed as the time derivative of the unit step, that is, 


«o(0 = 


d«_i 

~dr 


[449] 
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This is in agreement with the statement 389 since the transform for the 
unit step is given by Eq. 424 for the limit a—*0, and this result multiplied 
hy jo) reduces to l/27r. 

From a conservative mathematical point of view the differentiation 
of a function having a discontinuity is considered not permissible and is 
regarded as having no meaning. In view of the present discussion, how¬ 
ever, it is clear that such operations are f)ermissible provided they are 
properly interpreted. Thus it is possible to define functions and corre¬ 
sponding transforms for successive derivatives of the unit impulse. The 
first derivative is written 

«.(0 = ~ [450] 


and its transform, according to the statement 389, is 


j<av{oy) — 


2t 


[451] 
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Fig. 38. A rectangular 
pulse doublet. 


The function Ui (/) is called the unit doublet. The 
reason for this name is clarified by reference to 
Fig. 38 which illustrates graphically the manner 
in which the derivation of this function is to be 
interpreted. Starting with the function shown 
in this figure, one obtains the unit doublet Ui (/) 
by passing to the limit 6—^0. Since this limiting 
process may be indicated symbolically through 
replacing b by the differential time increment dt, 
the correctness of this graphical interpretation 


may be seen analytically from the fact that 

duo _ Upjt + dt) — Uo(t) 

Ht dt 


[452] 


or 


duo 

dt 


«0 


/ dt\ ( dt\ 
dt 


[453] 


When the statement 386 is applied, the corresponding transform is seen 
to be 


dt 


Zi(co)ya) dt 
dt 




[ 454 ] 


which agrees with the discussion surrounding Eqs. 450 and 451. 
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^ The unit doublet is evidently equivalent to a pair of equal but opposite 
mpulses which are immediately adjacent to each other at the origin. 
The net effect may be likened to that of a couple in mechanics, and for 
this reason the term couple is sometimes used in place of the term doublet 
to designate the function ui (/). 

It should be observed that the two impulses involved in this interpre¬ 
tation are not unit impulses. As shown in Fig. 38, the area enclosed by 
each rectangular pulse has the value 1/5. In the limit 5 —> 0 this area 
becomes infinite, and the resulting impulse is seen to be one of infinite 
value rather than one of unit V£due. These considerations are pertinent 
to the proper interpretation of the expressions 452 and 453 inasmuch as 
uo/dt symbolically represents an impulse of infi¬ 
nite value. 

Through continuing in the same way a se¬ 
quence of functions may be formed. The next in 
order is defined as 

and its transform, according to the statement 389, 
is given by 

{jo})h(w) = [456] 


1 

s 


5- 
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Fig. 39. A rectangular 
pulse triplet. 


The function W2(0 interpreted graphically as the limit of 

the time function shown in Fig. 39 as 5 is allowed to approach zero. It is 
equivalent to two equal but opposite doublets of infinite value centered 
about the origin and separated by the increment 5 = dL Thus one may 
write 


Jhii) = 


dui 

dt 




dt 


[457] 


and, making use of the statement 386 again, have for the corresponding 
transform 

di 

It is also possible to extend this sequence of functions in the opposite 
direction by successively integrating Wo(0* 

The first integration yields the unit function U\{t) or unit step. The 
next integration yields a time function which is linearly proportional to 
the time, like the current through a pure inductance when a constant 
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voltage IS applied. In connection with practical problems there is little 
actual use for any of the functions in this sequence except the unit 
impulse and the unit step, although a recognition of the availability 
and the interpretation of the general sequence of functions together with 
their transforms proves to be a useful tool in the application of Fourier 
integral analysis to various practical problems. 

According to the preceding discussion it should be clear that the 
transform of the general function Unit) in this sequence is (yw)V2ir. The 
sequence is referred to as the singularity funciionSy the unit impulse and 
the unit function being singularity functions of the order zero and minus 
one respectively. It should be observ^ed that the singularity functions 
multiplied by lir are the inverse transforms of the integer powers of (yw). 
Inasmuch as the inverse transform of (y^)"^ cannot be found in the usual 
fashion because the integral 350 becomes improper, the discussion in 
this article may essentially be regarded as an interpretation process 
which avoids this difficulty and demonstrates the existence of such 
integrals under suitable limiting conditions. 

25 . The error function and the sequence of singularity 

FUNCTIONS BASED UPON IT 

It has been seen from the preceding article that the unit impulse and 
its transform may be obtained through applying to other suitably chosen 
functions, besides the rectangular pulse, a limiting process by which 
they degenerate into a single infinite ordinate enclosing unit area. Corre¬ 
spondingly, the entire sequence of singularity functions and their trans¬ 
forms may be derived through applying suitable limiting processes to 
a variety of properly chosen functions. One of the most interesting of 
these is the so-called error function which has the form 

m = [459] 

According to the integral 375, the transform of the error function is 
given by 

g(a?) = - / e~°^*cos w/ dt [460] 

T vO 

The integration yields 

Here it is, incidentally, interesting to observe that for the choice a = 
one has 

/(/) = 


[462] 
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and 

g(u>) = [463] 

V2ir 

In other words, the time function and its transform are identical except 
for a scale factor. In particular, if the transform is defined as 
according to Eq. 365 and the Fourier integrals 366 and 367, the scale 
factor becomes unity and the time function is identical with its trans¬ 
form. This situation may also be achieved by using the integrals 369 
and 370, for which the transform (considered as a function of the cyclic 
frequency / = w/2t) is defined in terms of g(a)) by Eq. 368. Thus, with 
a in Eqs. 459 and 461 equal to x, and Eq. 368 being used, the time func¬ 
tion reads 

h(t) = [464] 

and its transform becomes 

iif) = [465] 

m 


t/i/a 

Fig. 40. The error function used in consideration of the singularity functions. 

Returning now to the Eqs. 459 and 461, letting a = «■/« and multiply¬ 
ing the resulting time function and its transform by the factor 1/Va, 
one has for the time function 

/(,) = £-— [466] 

Va 

and for its transform 

g(«) = —[^^^ 

This time function is plotted in Fig. 40. Since the area under the time 
function equals 2irg(0), it is clear that this area equals unity independent 
of the value of the parameter «. From Fig. 40 it is seen that as a becomes 
smaller the curve for/(/) becomes taller and narrower and, in the limit 
a 0, has the character of the unit impulse mo( 0- At the same time one 
recognizes, from the form of Eq. 467, that g{«) in the limit a 0 becomes 
equal to the constant value l/2jr, and hence identical with the transform 
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v(u) of the unit impulse. Thus the first of the sequence of singularity 
functions is obtained from/(/) of Eq. 466 for the limit a-*0, and its 
transform is found from Eq. 467. 

The remainder of the singularity functions are obtained from the 
successive derivatives of the function/(/) of Eq. 466 for the limit a 0, 
and the corresponding transforms of this sequence of functions follow 



Fig. 41. The first derivative of the error function used in consideration of the unit 

doublet. 


from the use of the statements 389 and 392 in connection with the 
transform 467. For example, the first and second derivatives of Eq. 466 
read 


and 


dt 



g-rflia 


[468] 


^ - g) 


[469] 


whereas the corresponding transforms are given respectively by 

g'(«) = y<(a,) = ^ [470] 

and 

g"(«) = (y«)2g(a,) = [471] 

These time functions are shown in Figs. 41 and 42, from which it is 
clear that for a —»0 they have the general character of the singularity 
functions Ui{t) and M2(0- In other words, the function 468 approaches 
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the unit doublet as a approaches zero, and the function 469 approaches 
the singularity function of order two. 

It is interesting to compare the time functions of Figs. 34, 38, and 39, 
resp)ectively, with those shown in Figs. 40, 41, and 42, and observe that, 
although the one set of curves is rectangular and the other set is smooth, 
both sets approach the same sequence of singularity functions when 
suitable limiting processes are carried out. This is evident from the fact 
that the transforms 467, 470, and 471 become identical with i»(w), 
and {_7w)*t/(<o) in the limit a —+ 0. 



Fig. 42. The second derivative of the error function used in consideration of the 
singularity function of order two. 

Since the error function and all its successive derivatives are smooth, 
use of them in the derivation of the singularity functions does not in¬ 
volve the mathematically doubtful steps encountered when the rectangu¬ 
lar pulse and its derivatives are used for this purpose. 

26 . Relation to contour integrals 

In applying the Fourier method of analysis to practical problems, one 
frequently encounters functions g(w) which are quite complicated, and 
for which the evaluation of the synthesis integral 350 presents some 
difficulty. Although the function g(w) may be complex, it should be clear 
that the integration is carried out with respect to the real variable w, 
and hence is essentially an integration of a function of a real variable. 
Inspection of the integral representation of g(u) according to Eq. 351, 
however, discloses that the variable w occurs only in the exponent of 
the exponential function and is there associated with the operator j. 
This fact shows that the transform g(«) may alternatively be regarded as 
a function oi ju> and written in the form giju). If this is done, and the 
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sjmthesis integral 350 is rewritten in the modified form, 

/W = ^ r." f (» d{jco) [472] 

j t/-j« 

it appears that this process of modification may be carried a step further 
through introducing the formal change of variable 

X = [473] 

writing Eq. 472 in the form* 

/(0= “ [474] 

J U—j no 

and, regarding g(X) as a function of a complex variable, 

\ = a + j<j) [475] 


evaluating the integral 474 by the method of complex integration dis¬ 
cussed in Art. 15 of the previous chapter. This method of integration, 
which is thus made available for the evaluation of the synthesis integral, 
holds promise for the simplification of many problems which present 
almost insurmountable difficulties unless one is exceptionally skilled in 
the art of real integration. 

Before this method of dealing with the synthesis integral may be 
utilized, however, it is necessary to clarify several significant points 
which, in the above formal steps, are left in a somewhat doubtful state. 
First it is necessary to assure oneself that the complex transform g(X), 
which is obtained from the ordinary Fourier transform by the simple 
expedient of replacing jw by a complex variable X, is in fact the analytic 
continuation of the function ^(/w) into the complex domain. Such a 
justification is called for because the Fourier integral 351 defines the 
complex function g only in terms of the real variable w, or one may say 
that it defines the function g(X) only for values of X on the imaginary 
axis of the X-plane. In other words, the Fourier integral 351 does not 
establish the existence of the function g{\) for all points in the X-plane. 
In fact if one writes the integral 351 in the form 

g(X) = ^ f fit) dt [476] 

ZTT t/—OP 

one immediately recognizes that this integral converges for / < 0 only 
for points in the left half of the X-plane and for / > 0 only for points in 
the right half of this plane. 

•Rewritten in terms of the variable X, the Fourier integrals are commonly referred to as 
Laplace’s integrals and as the Laplace transform of/(0* 
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The existence of g{\) for all complex values of X is, however, readily 
established with the help of the principle of analytic continuation and the 
uniqueness theorem for analytic functions (see Art. 11 of Ch. VI). Thus, 
suppose that a function g{ju) is given (that is, the function g{\) for 
X = ju) and let the problem be to find its analytic continuation into the 
X-plane. Suppose furthermore that somehow a function F{\) of the com¬ 
plex variable X is found which is identical with ^(X) for all p>oints on the 
imaginary axis (actually it is only necessary that F(X) and g(X) be 
identical for all points on an arbitrarily small portion of the imaginary 
axis or for an infinite number of discrete points having a limit point on 
the imaginary axis). Then, according to the uniqueness theorem, the 
functions F{\) and ^(X) are identical everywhere in the X-plane, and 
hence F(\) or g(\) is the desired analytic continuation of giju). 

Returning now to the integral 474, one finds that interpretation of it in 
terms of the method of complex integration raises a second pertinent 
question. The method of complex integration requires that the path of 
integration be in the form of a closed contour. According to the integral 
474, the path is the entire imaginary axis, from minus infinity, through the 
origin, to plus infinity. Suice infinity is regarded as a single point (this 
view is most easily appreciated through considering the comple: plane 
replaced by its associated complex sphere), one may say that the closed 
contour requirement is met by the integral 474. A difficulty arises, how¬ 
ever, because the integrand has an essential singularity at the point at 
infinity, since it contains the factor In the immediate vicinity of such a 
singularity a function is capable of assuming any assigned values (see 
Art. 13 of Ch. VI), and hence the method of passing through such a 
point cannot easily be disposed of. Unless the path of integration in the 
integral 474 is closed by passage through or around the point at infinity, 
the methods of complex integration cannot be applied, and yet the proc¬ 
ess of supplying this gap in the path of integration must be accomplished 
in a way which does not affect the value of the integral. 

For the following argument it is necessary to assume that g{\) is a 
rational function and that, for large values of X, it vanishes at least as 
1/X. Modifications in the procedure which are called for when g(X) does 
not fulfill these conditions are more appropriately considered later. In 
the immediate vicinity of the point at infinity the integrand is then 
essentially represented by the factor c^'/X. If the X-plane is, for the 
moment, regarded as replaced by its associated complex sphere, ac¬ 
cording to the method of stereographic projection, one now contemplates 
by-passing the point at infinity by means of a path increment in the form 
of a small semicircular detour concentric with this point. In the ordinary 
X-plane this detour corresponds to a semicircular path of very large 
radius with the origin as a center, as indicated in Fig. 43. This large 
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semicircle lies in the right or left half of the X-plane according to whether 
the point at infinity is by-passed on the right or on the left. 

In order that the detour shall contribute a negligible increment to 
the value of the integral, it is clear that e^^/\ must at all events remain 

bounded for points on the detour. For such 
points it is also clear that X has large values 
and that these values become infinite as the 
radius of the semicircular path about the point 
at infinity is made smaller and smaller, that is, 
as the radius R of the corresponding path in the 
X-plane of Fig. 43 becomes larger and larger. 
In order for e^^/\ to remain bounded, it is 
seen, therefore, that, for / < 0, the detour 
must lie in the right half plane where the 
real part of X is positive and that, for t > 0, 
the detour must lie in the left half plane where 
the real part of X is negative. 

It remains to show that, with this choice 
of detours for / < 0 and / > 0 respectively, the contributions to the 
integral 474 due to these added path increments are negligibly small. 
That is, one must show that the integral 

X e'Kt 

-iX [477] 



Fig. 43. The paths for 
replacing the Fourier in¬ 
tegral along the imaginary 
axis by a contour integral. 


extended over the semicircular paths as indicated in Fig. 43 has a negli¬ 
gible value for a sufficiently large value of R. For fX)ints on the semicircle 


and 


X = Re^^ = R (cos 0 + y sin 6) 


d\ 

T 


= jde 


[478] 

[479] 


so that the integral 477 becomes 


I = 



jRt Bin 9 

c 




[480] 


Since the factor has unit magnitude, it is clear that the value of 

the integral 480 extended over either of the two semicircular paths is 
certainly less than it would be if this factor in the integrand were omitted. 
As far as the magnitude of the integral is concerned, one may also drop 
the factory and have 
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According to the choice of paths for / < 0 and / > 0, it is observed that 
for / < 0 the limits of integration are from d = v/l toB — — t/2, and that 
for / > 0 they are from B = x/2 to 0 = 3ir/2. For either path, the expo¬ 
nent Rt cos 6 is negative, and since |cos0| ^ 1, one may state that for 
i < 0 , 

I"I<X2 = .^ [482] 

and for / > 0, 

/•3ir/2 /.,/2 2 ■r(^ — 

|/|<£ 2 / ) [483] 

For any nonzero |/|, the value of |/| may, therefore, be made arbitrarily 
small through choosing a sufficiently large value of R. 

According to the theory of contour integration, one recognizes that 
the radius R need be chosen only large enough so that the semicircular 
paths in Fig. 43 together enclose all the poles of the integrand. Since 
is an entire function, these poles are those of the rational function g(X). 

As a simple illustrative example, let the time function/(/) be the unit 
step w-i(/) with the transform g(\) = l/27rX. The synthesis integral 
then reads 

1 pj * 

In evaluating this contour integral one must again be reminded of the 
fact (discussed in Art. 24) that the transform of the unit step function 
is to be regarded as the limit of the function 

for a —> 0. The pole of this function lies at the point X = —a, and since 
a is an arbitrarily small but nevertheless nonzero quantity, one observes 
that the pole of the integrand in the integral 484 must be regarded as 
lying, not at the origin of the X-plane, but slightly to the left of this 
point. The closed contour for t < 0, therefore, does not enclose this 
pole, but the one for / > 0 does. Inasmuch as the residue of the integrand 
in this pole is unity (see Art. 15, Ch. VI, for the evaluation of residues), 
one readily recognizes that the integral 484 correctly represents the 
unit step function. 

The necessity of writing the transform for the unit step in the form 
given by Eq. 485 and considering the limiting process indicated by 
a 0 may be avoided if the path of integration in the vicinity of the 
origin is regarded as modified as shown in part (a) of Fig. 44. Instead of 
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passing through the origin, the path along the imaginary axis avoids the 
origin by passing to the right of it along a semicircular detour of vanish¬ 
ingly small radius.. That a detour of this sort 
is necessary follows from inspection of the 
integral 484 inasmuch as a pole of the inte¬ 
grand lies upon the path of integration. How¬ 
ever, unless one is aware of the limiting proc¬ 
ess which, in the limit, causes this pole to 
be located at the origin, one cannot know 
whether to by-pass this pole on the right or 
on the left. A knowledge of the limiting proc¬ 
ess which is necessary for the proper inter¬ 
pretation of the Fourier transform for the 
unit step function is thus seen to be neces¬ 
sary also for the removal of ambiguity in 
the reverse process of regaining this time 
function from its transform. 

It is possible for the integrand in the contour integral 474 to have 
several poles on the imaginary axis. A case of this kind arises when the 
time function has the form 

/(/) = w__i(/) * cos (coq/ “f* [486] 

which represents a steady sinusoid starting at / = 0. With the trigo¬ 
nometric function replaced by its exponential equivalent, the function 
486 may be written 

/(/) = (/) • [487] 



(aj (b) 


Fig. 44. Modification of the 
path of integration in the 
vicinity of fx)les of g(X). 


Utilizing the statement 385, one finds for the corresponding transform 


g(X) 




1 




+ 


1 


4ir (X - Xo) 4ir X + Xq 


[488] 


in which 

Xo = y&»o [489] 


The integrand in the contour integral for this g(X)-function evidently 
has poles at the points X = ±ywo on the imaginary axis. In the evalua¬ 
tion of this contour integral, these poles must evidently be by-passed in 
the manner indicated in part (b) of Fig. 44. The residues of the integrand 
in these poles are seen to be respectively 

—. and -[490] 

4r 4ir 


whence, observing again the selection of proper contours for / < 0 and 
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t > Oy one sees that the evaluation of the contour integral in this case 
correctly yields the time function 486 or 487. 

In each of the two examples just discussed, one observes that ^(X) 
does fulfill the condition of vanishing at least as strongly as 1/X for large 
values of X, It is appropriate at this point to consider in greater detail the 
necessity for this condition. One should here recall the discussion in 
Art. 8 relative to the character of Fourier coefficients for periodic func¬ 
tions which either are discontinuous themselves or possess discontinuities 
in their derivatives of the first or higher order. It is pointed out there 
that if the time function is discontinuous, the Fourier coefficients can 
become smaller no faster than in which v is the order of the harmonic 
coefficient and o) is the fundamental angular frequency. If the function 
is continuous but its first derivative is discontinuous, the coefficients can 
become smaller no faster than and so forth. 

Since these statements must obviously remain true as the period of the 
periodic function is made larger and larger, they apply also to the Fourier 
integral representation of a transient time function and its transform. 
The singularity functions Unit), whose transforms are l/27rX” are ap¬ 
propriate examples of this property. Inasmuch as the converse of these 
statements is evidently also true, one observes that the restriction that 
^(X) shall vanish for large X at least as fast as 1/X is seen to imply that the 
corresponding time function shall possess nothing worse than discon¬ 
tinuities. In other words, the method of contour integration is applicable 
to the evaluation of the synthesis integral only if the corresponding time 
function contains terms involving singularity functions of the order — 1 
or less. The impulse, for example, cannot be regained from its transform 
by the method of contour integration unless one employs special devices 
involving limiting processes similar to those used in the derivation of the 
transforms of such higher order singularity functions. 

From a practical point of view this restriction on the function ^(X) 
is hardly serious since the behavior of a physical system never exhibits 
the properties of an impulse or its derivatives unless the data are de¬ 
liberately idealized. Moreover, one can, in such idealized cases, always 
apply a simple artifice to overcome the difficulty imposed by this re¬ 
striction. For example, suppose ^(X) approaches a constant value for 
large values of X, implying that the corresponding time function contains 
an impulse. If the integrand is arbitrarily multiplied by 1/X, the state¬ 
ment 392 shows that the corresponding time function is replaced by its 
integral. Contour integration may then be applied, and the desired time 
function found through differentiating the result. In general, one may 
multiply the function g(X) by whatever power of 1/X is needed to obtain 
the proper behavior for large values of X and, after evaluating the contour 
integral, differentiate the result a corresponding number of times. 
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During this subscQUcnt process of differentiation, one must observe 
the following precautions. If the time function resulting from the contour 
integration contains discontinuities, its derivative contains a corre- 
spKjnding number of impulses. For example, suppose a time function /(/) 
has a discontinuity of the value h a.t t = io- The first derivative of /(/) 
then contains the term h- Uo{t — /o), its second derivative contains the 
term h • — to), and so forth. Each discontinuity is treated in this 

manner whether it appears in the function f{t) itself or in any of its 
subsequently formed derivatives. Besides terms of this sort, the deriva¬ 
tives of f{t), of,course, also contain terms representing the derivatives 
of the smooth portions of/(/). 

The second restriction which is placed upon g{\) in the above discus¬ 
sion of the resulting contour integration, namely, that g(X) be a rational 
function, may with some reservations next be relaxed to the extent of 
allowing g(X) to be a meromorphic function. As pointed out in Art. 18 
of Ch. VI, this class of functions is more general than the rational ones 
in that the point at infinity may be an essential singularity. Thus g(X) 
is allowed to be a transcendental function, although its singularities in 
the finite X-plane must still be ordinary poles. 

This relaxation of the conditions imposed upon g(X) requires further 
consideration of the process of contour integration from two aspects. 
These are concerned, first, with the effect of the essential singularity at 
infinity and, second, with the possibility of an infinite number of poles in 
the rest of the X-plane. A few simple examples will best illustrate how 
these matters may be dealt with. 

Suppose the time function is the rectangular pulse defined by the 
relations 360. Its transform is given by 


1 




dt = 


ttX 


[491] 


This is an entire transcendental function. Its only singularity is the one at 
infinity. Since the integrand in the contour integral 474 in this case has no 
poles at all, the entire process of evaluating this integral centers about the 
question of how the gap in the contour, which exists at the point at 
infinity, may be closed without affecting the value of this integral. 
Offhand, one may be tempted to conclude that the value of the integral is 
zero because the integrand has no poles. This conclusion is false, however, 
inasmuch as it is based upon the tacit assumption that the closure of the 
gap in the path of integration at infinity is to be dealt with in the manner 
described for rational g(X)-functions. Such an assumption is presumptive. 

The clue which leads one in the right direction is found through re- 
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writing the function 491 in the fonn 

whence the integrand in the integral 474 becomes 

^ (eX(m/a) _ gX(t-s/2)) j-493^ 

which, of course, is still an entire transcendental function. However, if 
the integrand is separated into two terms, each term is seen to have a 
simple pole at X = 0, and in the vicinity of the point at infinity to behave 
in the same manner as already described for contour integrals involving 
rational g(X)-functions except that the variable i is replaced respectively 
by (/ -f 6/2) and (/ — 6/2). The paths which previously were chosen for 
/ < 0 and / > 0 are now chosen for {i zk 8/2) < 0 and (/ db 6/2) > 0 
respectively. Except for these changes, the integral for each term has the 
form of Eq. 484 for the imit step function. Hence one obtains the result 

fit) = M_1 (^ + 0 - «-i - 0 [494] 

which is recognized without difficulty to meet the definitions 360. 

It should be observed that the question of how to close the gap in the 
path of integration at infinity is, in this example, resolved only after the 
integrand is separated into two terms, for the proper resolution with 
regard to one of these terms is different from that in the other. Unless 
the integrand is separated into two terms, it is obvious that the method of 
contour integration cannot be carried out for lack of an appropriate 
method of closing the path of integration. The method of contour integra¬ 
tion can be applied to other ^(X)-functions having essential singularities 
at infinity only if similar artifices can be devised for dealing with this 
question. 

Regarding the possibility of encountering transcendental j^(X)-functions 
having an infinite number of ix)les in the finite X-plane, one may consider 
the example in which is sought the current response to a unit step voltage 
at the driving point of a lossless open-circuited transmission line. Except 
for a constant multiplier, the g(X)-function in this case is of the form 


. . tanh X 

gi\) = —— 

[495] 

which has simple poles at the pomts 


(v = 1, 3, 5, • • ■) 

[496] 

and an essential singularity at infinity. 
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The question of how to close the gap in the path of integration at 
infinity is disposed of through obser\dng that g(X) remains bounded for 
large values of X in the right or left half plane (which is not the case with 
the function 491 of the previous example). Hence large semicircles like 
the ones shown in Fig. 43 can be found on which the contributions to the 
contour integral for / < 0 and ^ > 0 are negligible. This question may, 
therefore, be resolved in a manner similar to that discussed for rational 
^(X)“functions. 

It remains to determine how one shall deal with the infinite number of 
poles of g(X) inq^smuch as any semicircular path, no matter what its 
finite radius may be, cannot enclose all these poles. The difficulty pre¬ 
sented by the fact that these poles lie upon the path of integration is, 
incidentally, overcome through avoiding them by means of small detours, 
after the fashion showm in Fig. 44. This procedure is valid since, for a 
transmission line with some loss, however small, the corresponding poles 
lie in the left half of the X-plane. 

The residues of the integrand in the integral 474 with the g(X)-function 
of Eq. 495 are found to be given by 


Pv = 


sinh^ Xx, X t 
-^ ^ 


J?,.. ^±jv7rtl2 


[497] 


The significant point about this result is that the residues vary inversely 
as Xv. Hence they become smaller and smaller for poles which lie more 
and more remote from the origin of the X-plane. The terms in the corre¬ 
sponding time function, therefore, become negligibly small for very 
remote poles. Since any number of terms in the desired time function 
are readily calculated, the question of choosing a sufficiently large radius 
R for the semicircular paths of Fig. 43 evidently depends u}X)n the 
degree of approximation to which the result should be determined. The 
contour integral yields the time function in the fonn of an infinite series, 
which incidentally is recognized as being the Fourier series for a sc|uarc 
wave. 

By making use of the statement 392, and observing that multiplying 
g(X) by 1/X” has the effect of multiplying the corresponding residues by 
1/X„^, one obtains a much more rapidly convergent .series, but this effect 
is canceled by the subsequent n-fold differentiation. In practical prob¬ 
lems in which the form of the resulting time function is not recognized 
from inspection of its scries representation so easily as it is in the present 
example, a reasonable number of terms usually suffice for a sufficiently 
good approximation provided the series converges. The question of the 
convergence of the series can always be examined by means of the expres¬ 
sion obtained for the residues. 

In some practical problems one may also encounter /j(X)-functions 
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which are multivalued. For example, the determination of the response 
of an artificial transmission line to an applied unit step voltage leads to 
the transform 


g(A) = 


2ir\/X^ + -f + X)“ 


[498] 


in which n (the number of line sections) is an integer. The inverse trans¬ 
form is given by the integral 




+ o^ + X)” 


d\ 


The first step in the process of simplifying this integral is to let 


X 

- 

a 


which converts 499 into the form 

= hsi. 


g,V}Ott 


2irj J-j * Vw^ + + 1 + 

Next one introduces the change of variable indicated by 


■dw 


whence 


vsrri - l(z + i) 


[499] 

[500] 

[501] 

[502] 

[503] 


and, from the addition or subtraction of these two equations, one finds 

[504] 


z = Vw^ + l+ w 


and 


= Vzer + 1 — w 


Forming the differential of Eq, 504 yields 

Vw^ - 4-1 + w . 

az =- ■ — ^ — dw 

\/w'^ + I 

whence, using Eq. 504 again, one has 


dw 


dz 


z Vw^ + I 


[505] 


[506] 


[ 507 ] 
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By means of Eqs. 502, 504, and 507, the integral 501 assumes the greatly 
simplihed form 

I ^ (z-l/x) at/2 

in which the contour C in the z-plane must be chosen to correspond to 
the contour in the w-plane which is implied in the evaluation of inte¬ 
gral 501 by the method of complex integration. 

Because of the multivalued character of the integrand in Eq. 501, 
the determination of an appropriate closed contour must be considered 
with some care. First it is observed that for large values of w the trans¬ 
form g(w) varies as l/w”'*'^, and hence, even for « = 0, it fulfills the 
requirements stated earlier regarding the method of closing the gap in 
the path of integration at the point at infinity. Hence one may again 
contemplate closing this gap in the manner shown in Fig. 43 for f < 0 
and / > 0 without affecting the value of the integral. 

Next it is seen that for integer values of n, the Riemaim surface for 
the integrand of Eq. 501 has two leaves. The values w = ±y are branch 
points, and the portion of the imaginary axis between these is regarded 
as a branch cut. Since the point at infoity is not a branch point, the 
two leaves of the Riemann surface remain separate in this vicinity, and 
the path of integration around this point, therefore, remains on one of 
these leaves. 

The branch points, which also are simple poles of the integrand (see 
the discussion immediately following Eq. 256 in Art. 18 of Ch. VI), must 
be avoided in the manner already described by means of small semi¬ 
circular detours in the right half plane. In so doing, the path of integra¬ 
tion also remains on the same leaf of the Riemann surface (as discussed 
in greater detail below) and the condition that the contoiir be dosed is 
fulfilled. 

In order to determine the contour C in the z-plane for the integral 508, 
it is necessary to consider in greater detail the substitution 502 and its 
inverse 504. For this purpose it is effective to determine the conformal 
map in the w-plane corresponding to orthogonal families of concentric 
cirdes and radial lines symmetrical with respect to the origin in the 
z-plane. With 

z = [509] 

the loci in the z-plane are defined by f = const and ^ = const. Substitut¬ 
ing into Eq. 502, one has 

T 1 

w = u +jv - - (cos +j sin ^) - — (cos <l> — j sin <l>) [510] 
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whence 



Eliminating ^ on the one hand and r on the other, one obtains respectively 



Fig. 45. Conformal representation of the substitution given by Eqs. 502 and 504. 


For various values of r, Eq. 512 represents a family of confocal ellipses, 
with foci at the points u = 0, v = ±.j (that is, w = ±;). These loci are 
shown in Fig. 45. For r = I, the ellipse degenerates into the doubly 
traversed portion of the imaginary axis between the points w = ±y. 
The same ellipse is evidently obtained for reciprocal values of r, a very 
large or a very small value of r yielding a large ellipse with very little 
eccentricity, that is, one which is very nearly a circle concentric with the 
origin. One observes that the interior of the unit circle in the z-plane 
(r < 1) is mapped upon the entire iw-plane and that the exterior of the 
unit circle in the z-plane (r > 1) is also mapped upon the entire a»-plane. 
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The multivalued character of the fimction 504 is thus evident, inasmuch 
as two ^-planes (the two leaves of a Riemann surface) are needed to 
map uniquely all points in the 2 -plane. The two leaves of the Riemann 
surface in the 7e;-plane represent regions upon which the interior and 
the exterior of the unit circle in the 2 -plane are mapped respectively. 
The boundary between these two regions in the 2 -plane is the unit 
circle r = 1; in the w;-plane it is the degenerate ellipse. The latter is the 
branch cut in the Tt^-plane through which one passes from one leaf of the 
Riemann surface to the other. 

For various values of 0, Eq. 513 represents a pair of families of confocal 
hyperbolas, which are images of each other about the real axis. These 
loci, which are also shown in Fig. 45, are orthogonal to the ellipses 
defined by Eq. 512, and their foci also lie at the points w == zkj. The 

asymptotes of any hyperbola on one of the leaves 
of the Riemann surface make angles with the 
positive real axis which are equal to the values 
of 0 appropriate to the corresponding branches 
of that hyperbola. On the other leaf, the angle 
between an asymptote and the positive real 
axis jis IT — 0. Suppose the top leaf to be that 
one on which the angle is 0, and the lower one 
that on which the angle is tt — <^. Then if, for 
example, the branch of the hyperbola in the top 
leaf for <t> = 30° (this is in the first quadrant) 
is traversed in the direction toward the branch 
cut, one finds, after following this hyperbola 
through the branch cut (into the second quad¬ 
rant) that one is now on the lower leaf but still 
on an hyperbola to which <f> = 30° is appropri¬ 
ate. If, instead of passing through the branch 
cut, one imagines jumping over it so as to remain on the top leaf, one 
finds oneself on an hyperbola (in the second quadrant) to which 
0 = 180° — 30° = 150° is appropriate. 

With these properties of the substitution 502 in mind, it is easily 
appreciated that the path in the 2 -plane corresponding to the imaginary 
axis in the le^-plane, traversed from —j oo to +j <» (avoiding the points 
w = ±j by remaining slightly to the right of them), has the form shown 
in Fig. 46. The process of closing the path in the tc^-plane by means of a 
large semicircle in the manner shown in Fig. 43 corresponds to closing the 
path of Fig. 46 in the 2 -plane in the same manner.* The large semi- 

is true, of course, that a large circle concentric with the origin in the ^^^-pla^e is not 
exactly (although very nearly) also a circle in the 2-plane. This fact is, however, unimportant 
inasmuch as the argument regarding the closure of the path of integration does not require 
that the path increment in question be circular in form. 



Fig. 46. Path in the 
2 -plane corresponding to 
the y-axis of the w-plane, 
according to the substitu¬ 
tion shown in Fig. 45. 
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cirdes for < < 0 and t^> 0 also lie in the right and left hdf planes respec¬ 
tively. The contour C in the integral 508 is thus determined. 

For / < 0 the value of this integral is evidently zero, for the integrand 
has singularities only at the points z = 0 and z = <». For / > 0 the con¬ 
tour C endoses the one singularity at z = 0 . This contour may, therefore, 
be given any other form, as long as it endoses the origin in the z-plane. 
Choosing the iinit cirde for the path C and writing in conformance with 


Eq. 509, 

z « 

[514] 

one has 

II 

[515] 

and 


[516] 

so that the integral 508 becomes 



/(a/) = 

[517] 


This result is seen to be identical in form with the integral representation 
for the Bessel function, as given by Eq. 307. Hence one has for / > 0 , 

f{at) = Jn{od) [518] 

It may be of interest to observe that the integral 508 alternatively 
represents the coefficients in in a Laurent expansion of the fimction 
g(*-i/*)o </2 about its essential singularity at z = 0. One recognizes this 
fact from a comparison of Eq. 166 of Ch. VI with the integral 508, 
remembering that C is a contour enclosing the origin in the z-plane. As 
discussed in Art. 7, the substitution 514 converts the Laurent expansion 
into a complex Fourier series. One thus obtains the Fourier series rep¬ 
resentation for the function 303 dealt with in Art. 16. 

An additional interesting feature about the transformation from the 
integral 501 to the integral 508 by means of the substitution 502 deserves 
special mention. In examining the integrand in the integral 501 one 
observes (as pointed out above) that the points w = ±7 not only are 
branch points but also are simple poles, since the factor + i be¬ 
comes zero there. As the corresponding points in the z-plane, which from 
Eq. 504 are seen to be z = zkj, the integrand in the equivalent integral 
508, however, does not possess singularities. The reason for this peculi¬ 
arity lies in the fact that the fimction w(z) represented by the substitu¬ 
tion 502 possesses saddle points (see Arts. 14 and 18, Ch. VI) at z = ± 7 . 
This fact becomes evident upon the forming of the derivative of Eq. 502, 
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which reads 



This derivative has simple zeros for z = ±J. Since the second derivative 
does not vanish at these points, they are saddle points of the first order. 
The vanishing of dw/dz at the points z = ±j, corresponding to w = ij, 
may also be seen from Eq. 507. Since the quantity dz/z = dw/Vv^ + 1 
remains regular in these points, the integral 508 does so likevdse. For this 
reason it is unnecessaiy that the contour C of Fig. 46 be modified so as to 
avoid the points z = ±y; the path of integration in the z-plane may pass 
through these saddle points. 

It may also be of interest to recognize that the integral 508, except 
for the factor H, is equivalent to Sommerfeld’s integral 306. In place of 
the relation 514, one uses the substitution 

z = [520] 

in which t is regarded as a new complex variable. Writing p for at and 
dropping the factor one has the integral 

Z„(p) = - r[521] 

This is simply an alternative form for Sommerfeld’s integral as given by 
Eq, 306. The latter form is obtained from Eq. 521 by making the addi¬ 
tional change of variable 

f = ^ - r [522] 

The minus sign resulting from the fact that df = —dr is unimportant 
inasmuch as it may evidently be canceled through traversing in opposite 
direction the path of integration, which as yet is not specified. 

For the various kinds of cylinder functions* defined by the integral 
521, the path of integration L begins and ends at infinity. In order to 
insure the convergence of the integral, it is necessary (assuming p > 0) 
that the portions of L which extend toward infinity do so within regions 
of the T-plane in which the real part of^ sin t remains negative. Letting 
T = <t> one has 

j sin ■hjv) — — cos ^ sinh +jr sin <t> cosh [523] 

•For the demonstration showing that the function 521 formally satisfies Bessel’s equation 
(which is dissociated from the present discussion), the reader is referred to the literature on 
this subject, for example, R. Courant and D. Hilbert, Methoden der tnathemaHschen Physik^ 

I (Julius Springer, 1924), 382, or E. T. Copson, Theory of Functions of a Complex Variable 
(Oxford, 1935), 313. 
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whence it is readily recognized that the regions in which the real part is 
negative are those shown cross-hatched in Fig. 47. Paths such as those 
labeled Li and may, therefore, be regarded as closing upon them¬ 
selves at infinity, so that the principles of contour integration become 
applicable. 

The detailed form of such a path within a cross-hatched region may, 
therefore, be modified at will without affecting the value of the integral. 
Thus the path Li may alternatively be assumed to lie along the imagi- 


4 > 


Fig. 47. Appropriate paths of integration Fig. 48. Paths in the z-plane 
passing through saddle points, used in the corresponding to modified ver- 

approximate evaluation of Sommerfeld’s sions of L\ and in the r-plane 

integral. of Fig. 47. 

nary axis from 17 = <» to 7; = 0, thence to lie along the real axis from 
</> = 0 to <#► = TT, and from there to proceed toward 77 = — 00 along the 
vertical line <^ = tt. Similarly, the path Lo may be assumed to lie along 
the line 0 = — ir from 77 = — «5 to 17 = 0, thence to lie along the real 
axis from 0 = —tt to = 0 , and finally to proceed toward 77 = 00 along 
the imaginary axis. 

The paths Ci and C 2 in the 2 -plane, corresF>onding respectively to these 
modified versions of the paths Li and L 2 in the r~plane, are shown in 
Fig. 48 (with due allowance for slight departures necessitated by drawing 
both paths in the same figure). 

The specific functions defined by the integral 521 for the paths Li and 
Z 2 are referred to as the Hankel functions or also as Bessel functions of 
the third kind. These are 

= - r 

TTt/Li 




[ 524 ] 
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and 

(p) = 1 r ei(p»in»-«r) j-525] 

TT 9/Li 

For real as well as complex values of p, these functions are complex. 
The conjugate value of ^„^‘^(p) for real values of p is given by 

fl„(i)(p) = i [526] 

in which every .point on the path Zi is the conjugate of a corresponding 
point on Li, that is, Zi is the image of Li with respect to the real axis. 
If T, the variable of integration, is replaced by — t, every point on the 
path of integration is replaced by its negative; that is, the path of integra¬ 
tion becomes replaced by its image about the origin. If the latter path is 
denoted by —Li, one may write in place of Eq. 526 

= [527] 

It is now observed that the path —Li is the image of Li about the 
imaginary axis. Reference to Fig. 47, therefore, shows that —Li is 
identical with the path Z 2 except for a reversal of the direction in which 
it is traversed. Changing this direction merely reverses the algebraic 
sign of the result. Hence one has 

SJ'Hp) = - r dr = [528] 

TL 9/Li 

that is, for real values of p, the Hankel functions of the first and second 
kind are conjugate complex. 

The sum of these two functions may be expressed by a single integral 
of the form 521 in which the path L is the resultant of the paths Lx and Z 2 . 
Reference to Fig. 48 shows that the corresponding resultant path in the 
2 -plane is the unit circle enclosing the origin. According to the preceding 
discussion this path yields the Bessel function /n(p), hence 

J„(p) = (p) -f H„(«(p)} [529] 

For real values of p, one may regard the Bessel function as the real part 
of either of the Hankel functions. The relation 529, however, is by defini¬ 
tion assiuned to hold for complex as well as for real values of p. 

For the sake of completing the present picture, it may be mentioned 
that the so-called cylinder functions of the second kind (also called 
Neumann functions) are given in terms of the Hankel fimctions by a rela¬ 
tion complementary to Eq. 529, namely, 

Nnifi) = 


[530] 
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One observes that the Hankel functions are analogous to the exponential 
functions C'** and e the Bessel and Neumann functions to cos x and 
sin * respectively. 

Asymptotic expressions valid for large values of the argiunent p may 
be obtained through evaluating the integrals 524 and 525 by the so-called 
“ saddle-f)oint ” method. In terms of the variable t defined by the sub¬ 
stitution 520, the function 502 reads 

w = j sin T = [531] 

The saddle points which, in the 2 -plane, occur for z = rfc/, are located 
in the r-plane at the p)oints t — ± 7 r/ 2 . Reference to Fig. 47 shows that 
the paths Li and Z ,2 pass through these points. There the value of u is 
zero, whereas on either side of a saddle point«is negative. The exponen¬ 
tial function 

gipsinr ^ gp(u-H») j-532] 

appearing in the integrals 524 and 525, has the magnitude 

jgipBinr| = gPU g 1 [- 533 ] 

the value unity obtaining at a saddle point. 

If one is mindful of the general character of the contours in the r-plane 
defined by « = constant and v = constant, as discussed in Art. 14, 
Ch. VI (in particular, see I’ig. 10 of Ch. VI for s = 2), one observes 
that if the path of integration is chosen to coincide with that contour 

V = constant which passes through the saddle point, the function «, and 
hence the exponential function given by Eq. 533, experience their most 
rapid rate of growth and subsequent decay. This fact is readily appre¬ 
ciated if one utilizes the analogy of regarding the loci u = constant as 
being contour lines in a mountainous terrain, and the orthogonal loci 

V = constant as indicating the direction of the gradient (direction of 
steepest ascent) in this terrain. The saddle point has the character of 
a mountain “ pass,” and the contour v = constant which passes through 
the saddle point represents the shortest route along which one may scale 
the height of the “ pass ” and descend into the valley beyond it. Clearly 
then, if this route is chosen as the path of integration, the values of the 
exponential function 533 pass continuously and most rapidly from the 
negligibly small magnitudes which obtain for points within the shaded 
regions of Fig. 47 remote from the origin, through their meiximum (which 
occurs at the intersection of the path with the real axis), and back to 
negligibly small magnitudes again. 

It is also readily appreciated that the portion of the path (in the 
vicinity of a saddle point) throughout which the exponential function 
has appreciable values becomes shorter as p becomes larger. For large 
values of p, therefore, the principal contribution to the value of either 
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of the integrals 524 or 525 is furnished by a rather short path increment 
in the immediate vicinity of the respective saddle point. An integration 
over such a short path increment alone then yields substantially the 
correct value of the desired function, the approximation becoming 
asymptotically better and better the larger the value of p. 

In order to be able to carry out such an integration, one must first 
determine the direction (in the r-plane) of the contour v = constant 
passing through the saddle point. From Eqs. 523 and 531 one has 

u — — cos 4> sinh ri 


and 


» = sin ^ cosh 


[534] 


At the saddle points t = ±ir/2 (that is, <(> — ±x/2, t) = 0), so that, as 
pointed out above, u = 0 and 

V = Vq = j^sin cosh = ±1 [535] 


Along a contour v = constant one has 

dv = 0 = cos <t> cosh ri d<t> + sin <i> sinh t] dri [536] 


from which 


— = — tan <p tanh rj 
dri 


[537] 


By use of Eq. 535 the values of this derivative at the saddle points are 
found to be 


d(f> . . 

— — sm ^ = =F 1 

arj 


[538] 


in which the minus sign applies to the saddle point at t = +t/2 and 
the plus sign to the one at r = — 7 r/2. Hence the path Li, which passes 
through the saddle point at r = t/2, should do so at an angle of —45 
degrees with respect to the real axis, whereas the path L 2 should pass 
through its saddle point at t = — 7r/2 at an angle of +45 degrees. The 
paths shown in Fig. 47 comply with these conditions. 

Next it is necessary to determine the detailed behavior of the function 
in the immediate vicinity of the saddle points. This behavior 
must be expressed in terms of a variable which represents length measured 
along the respective paths of integration through these points. If this 
variable is denoted by Sy the above determination of the path increments 
through the saddle points shows that one may write for the immediate 
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vicinities of these points 


T = ± ^ -h 

[539] 

whence 


20 = y sin T = ±y cos 

[540] 


Here s is regarded as a small quantity, so that one has approximately 
w s (i - y = ±y(i ±i 0 = - y ± y [541] 


and, therefore, 



The value of v, according to the result 541, of course, agrees with that 
expressed by Eq. 535. The exponential factor 532 finally becomes 

^;psinr^^±yp.^-ps*/2^ H<1 [543] 

in which the plus sign in the exponent is to be used in the integral 524 
and the minus sign in the integral 525. 

The exponential factor which also appears in these integrals, 

may, for the short path increment over which the integration is ex¬ 
tended, be regarded as slowly varialjle compared with the factor 543, and 
hence as replaceable by its values at the saddle points. These are 

^qF;n7r/2^ 

Observing, according to Eq. 539, that 

dr = is [544] 

one then has for the desired asymptotic expressions for the integrals 
524 and 525 

(p) 21 - j-545j 

TT V—€ 

and 

27 „^ 2 ) (p) ^ I g-Kp-nrl 2 ~rli) jT^' 1-545^ 

in which 2t is the length of the small path increment over which the 
integration extends. If the integrand is plotted versus s for large 

values of p, one finds that the area under this curve is confined sub¬ 
stantially to the immediate vicinity of the origin (s = 0). In other words, 
the total area under this curve (which is obtained through integrating 
from s = —00 tos = oo) differs from the area within a small region in 
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the vicinity of the origin by an amount which becomes smaller and smaller 
as p becomes larger and larger. The total area is given by 




[547] 


Hence one has for the desired as 3 m[iptotic expressions for the Hankel 
functions 





gytp-(2n+l)T/4] 


[548] 


and 



^—y[ p—(2n-f 1 )rf4] 


[549] 


According to Eq. 529, a corresponding asymptotic form, valid for 
large p, is obtained for the Bessel function 

7n(p) ^ cos - -- - - [550] 

For n = 0 and « = 1 this result yields the formulas given by Eqs. 322 
and 323 in Art. 16. 

It may be well to point out that the approximate expressions just 
derived do not yield accurate results if the parameter n as well as the 
argument p is large, that is, if n and p are of the same order of magnitude. 
The truth of this statement Ls readily seen from the fact that if n is also 
large, the factor appearing in the integrals 524 and 525, may no 
longer be regarded as essentially constant throughout the path increment 
over which the integration extends. 

For a more general treatment of the present problem, one begins by 
setting 

p = an [551] 

and rewriting the integrals 524 and 525 in the forms 

(««)=- [552] 

7r«/Li 

and 

H„<»(a«) =- dr [553] 

TT t/Li 


In considering the saddle-point method of integration one then lets 

w =j{a sin T — t) = « +jv [554] 
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The saddle points are those values of r for which 


yielding 


dw 

dr 


j(a cos T — 1) = 0 


1 


cos T = ~ 
a 


[555] 

[556] 


For large values of a (that is, for p » «), Eq. 556 yields very nearly 

cos T = 0 or r = d=ir [557] 

which are the saddle points of the function j sin t considered above. 

The complete treatment of this problem (a being assumed real) re¬ 
quires separate consideration of the cases a > 1, a = 1, and a < 1. One 
obtains, in this manner, representations for the cylinder fimctions in the 
form of semiconvergent series of which the approximate results derived 
above are the first terms. The further detailed discussion becomes too 
specialized to be included under the heading of the present article,* in 
which the primaiy objective is to consider the essential principles in¬ 
volved in the use of complex integration for the evaluation of inverse 
Fourier transforms. 


PROBLEMS 

1. Make sketches of periodic functions which have the following specific char¬ 
acteristics: 

(a) The Fourier series contains only sine terms but all harmonics are present. 

(b) The Fourier series contains only sine terms and only odd harmonics. 

(c) The Fourier series contains only cosine terms but all harmonics are present. 

(d) The Fourier series contains only cosine terms and only odd harmonics. 

(e) The Fourier series contains sines and cosines but only odd harmonics. 

(f) The Fourier series has the property that the odd harmonics are sines and the 
even ones are cosines. 

(g) The Fourier series has the property that the odd harmonics are cosines and the 
even ones are sines. 

(h) The Fourier series has only even harmonics. 

(i) The Fourier series has harmonics of order a, 2a, 3a, • • •, a being any fixed 
integer. 

2. Given a set of functions for ^ = 1, 2, • • • n, with the following properties, 
is periodic, having the period r. 

* 4 )\{t — ^i), — /a), • • *^11(0 = — tnr^i) 

in which h, h, • • • are any finite quantities. Let the sum of these functions be 
denoted by i.e., 

“ £ 4>k(f) 
k^l 

*This material may be found, for example, in Courant-Hilbert, op, cif,, pp, 43fi-440, or 
E. T. Copson, op, cit, pp. 330-336. 
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If the function 0i(/) has a Fourier series representation with the cosine and sine 
coefficients av and hv, respectively, show that the corresponding coefficients for the 
resultant periodic function are given by the expressions, 

Aq = nao 

n n 

Au — av XI cos voiik — bv ^ &in. v<j^tk 

n n 

By — bv ^ cos vwtk + ai. 2^ sin vcatk 

fc-i ib=i 

HifU. Write the Fourier series for <l>k(0 and 0(0 in exponential form first and then 
convert to the trigonometric forms. 

3. Suppose, for the set of functions defined iif the preceding problem, one chooses 
tk = kir/n). The periodic functions <t>i, 02, ’ ‘ ‘ <l>n then form a cyclic group. Show 
that their sum 0(/), when it neither vanishes nor reduces to a constant, represents a 
periodic function with the period r/n. Show that the same is true of the function 
F(t) = 01 X 02 X • • • X 0n given by the product of the functions forming the 
cyclic group. 

4. For the sum function 4>(i) of the previous problem show that its Fourier coeffi¬ 
cients and are given in terms of av and hv for the component functions by the 
simple relationships: Ay, = nav, By ~ nbvy for /a = 0, 1, 2, • • • and v = tifi. Correlate 
this result with the formulas given in Prob. 2. 

5. As an application of the principles illustrated by the previous problems, let 

0i(O = sin wf for 0 < i ~ 

(j9 

.#.«)= 0 i0T-<t< — 

Cl) Cl) 

and consider the cyclic groups for n = 2, 3, 6, 12, representing wave forms resulting 
from polyphase rectification. Compute the coefficients Ay and By according to the 
formtilas of the previous problem and check, through carrying out the usual integra¬ 
tion. 

6. Square pulses of amplitude A and duration d = t/10 characterize the periodic 
function 

0i(O = for 0 < < < ^ 

0i(/) =0 for^ < ^ < T 

Find the spectrum of this function and compare it with those obtained from a cyclic 
group for n = 2 and « = 3 according to the principles given in the previous problems. 

7. In applying the formulas in Art. 15 to the numerical evaluation of Fourier 
coefficients for graphically given functions, a simplifying expedient is to alter the 
number of intervals n according to the order of the Fourier coefficient being calculated 
instead of using the same fixed number of intervals for the calculation of all coefficients. 
For example, if, in the use of formulas 299 to 302, one chooses w = r, all the akr and 
fikr become ±1 or zero, and the resulting computations are corresF>ondingly simplified. 
This procedure, known as the Fischer-Hinnen method, must evidently be applied 



CA. VIll 


PROBLEMS 


571 


with care. The results are not good for the fundamental and lower harmonics but 
improve with increasing order. 

Try this method out on a function /(jc) whose values for a; = 0, ~ ~ are 

18 9 6 2 

respectively 0.0,4.0,7.0,8.9,9.7,10,9.5,9.0,8.7,8.65, assuming that/(—x) = ~/(x) 
and /(x +7r) « ~/(^). Compute harmonics through the seventh. Compare with 
results obtained from computations that do not utilize this simplified approach. Plot 
both results and compare with a plot of the given function. 

8. For increments in x equal to t/ 12, starting with x = 0, the values of a given 
function f(x) are: 

0,4.2, 8.9,9.9,9.5, 8.9, 8.5, 8.9, 9.5, 9.9, 8.9, 4.2,0, 

1.5,1.8,1.9, 2.1, 2.5,3.0, 2.5, 2.1,1.9, 1.8,1.5,0 


Choosing w * 12, use the formulas 299 to 302 to compute the harmonics through 
the 11th. Plot the resulting partial sum and compare with the given function. 

9. Given the function f{x) = f(x + 2irk) defined by 


f s 



2t X 


a 


forO < X < a 
ioT a < X <27r — a 
for 2t — a < X <2v 


Show that for this function On =» 0 and 


^ 2 sin na 

” a(T — a)n^ 

From this result determine the Fourier series for the following functions having the 
same period: 


/i(*) = 


h(.x) = 




IT —X 
«• 

IT 

2(t ~ x) 

T 

2(27r ~ x) 
TT 

X 

TT 

2ir — « 


for 0 < x < 27r 


for 0 < « < ~ 

, TT Sir 

for 2 <'2 

. 3Tr _ 

for — <x <27r 


for 0 < X <T 
for w < X <2ir 


Make sketches of all the functions. 
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10. Find the Fourier expansion for a periodic function defined by 
10 for 0 < / < o; ^ 


/(/) = 


sin TT - for a < f < T — a 

T 

0 for r — a</<T 


Make a plot of the function and find the form of the Fourier series corresponding to 
a == 0. Find the sum of the series for / — a and / = t — a. 

11. A function /(t) is defined by 


0 



1“ 


for 0 < f < ^ — a 
for^~o<f<^+a 
for ^ + fl < f < T 


Determine the Fourier series expansion. Plot the function for a = t/ 5 as well as the 
partial sums 5i, ^ 2 , * * * <^ 5 , thus showing the manner in which the given function is 
approximated. Plot the spectrum function for the same value of a. 

12. A periodic function consists of a regular succession of identical pulses of short 
duration (similar to the function of Prob. 11 for a/r 1) the area under each pulse 
being A . Show that the values of the constant term and those of the fundamental and 
lower harmonic amplitudes are very nearly independent of the detailed pulse shape 
(whether rectangular, triangular, sinusoidal, etc.), being proportional only to the 
pulse area. Deduce the pertinent relationships. As the duration of the pulse is assumed 
to become shorter and shorter, the area remaining the same (=-4), show that the 
Fourier coefficients are ultimately given by Uo = -d/r, a„ == 2A/t, independent of «. 

13. Check the expansions of the following functions for the interval 0 ^ x ^ tt. 
Plot the functions and several terms of the series, noting rapidity of convergence. 




n-1,3,5 • 


sin nx 


^ (tt ~ 2x) (tt^ 4- 2Trx — 2x^) 
vo 


ee 

L 


n = l,3,5,--- 


cos nx 


14. Consider f(x) = (^) (tt — x) sin x within the interval 0 ^ a; ^ tt, and check the 
following series representation: 

1 ^ 1 , 1 . 

- -h “ cos x: — — cos 2x — — cos 3a; — — cos 4a: — •• • 

2 4 1-3 2-4 3-5 


15. By using the Cauchy principle of convergence, show that the series 

5=2 sin nx 
n=i n 

converges uniformly except at the points a: = 0, 27 r, 47 r, • • • 
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16. Determine the regions of uniform convergence of the series 

5 a 

n«o n 

and define the points at which it diverges. 

17. Show that the series 

«0 

2 cos nz and 2** sin nz 

0 

converge absolutely and uniformly inside a circle of unit radius. 

18. Show that the series 


X) anZ^ cos nz and 22 sin nz 
0 

converge absolutely and uniformly inside a circle of radius 

R = limit 

n—¥ BO 

19. Discuss the convergence of the series 


5 *= sin nx 

n»0 

in which an > Un+i > an+z • • • and Un 0 for « -+ oo. Does the point x « 0 belong 
to the region of uniform convergence? 

20, Show that the series 

. sin 2x sin ^x sin nx 

sm a; H---1-;;-h • * * H-h * • • 

2 3 n 

converges uniformly except at points a: = 0, ±27r, dziw, • • • . 

21. Show thatrlhe series 


^ ^ cos nx 

o = 2 ^ 5 

n = 1,3.5, -•• 

converges uniformly to the function (tt — 2ap)7r/ 8 in the interval 0 ^ a: ^ tt and to 
the function (ac — 37r/2)7r/4 in the interval tt ^ x ^ Zw. 

22. Show that the expansion. 



cos ac — -T cos 2x + cos 3x — —z cos 4ai; H- 

2^ 3-* 4* 


converges uniformly in the interval —x* ^ ar ^ tt. Through an obvious change of 
variable obtain the series 



4c2 



1 27ry 1 3wy 
-rcos— +:r;COS— ~ +- 



and state its interval of uniform convergence. 

23. Using the results of Prob. 22, show that 


![! = 1 

12 2* 3* 4* 
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and 


1 


24. Using the results of Prob. 22, show that the series 


C 4c r TX 

-- 2 — 

2 TT^ L c 


1 Ztx 


1 Sir* 1 
+ -,cos —+...J 


converges uniformly within the interval 0 ^x ^ c, and obtain the result 

T* 111 

-^ = 1 + p+p + +■ ■ ■ 

25. Through the use of a Laurent expansion obtain the series 

1 — r cos z ^ n ^ ^ ^ 

- - - ;—5 = 1 4- r COS 2 -f r* cos 2z 4- r* cos 32 + • • • 

1 — 2r cos 2 -I- 

in which r is real but z may be complex. Show that the region of convergence is defined 
as — 1 < r < 1. 

26. Find the continuous spectrum for the fimction 
jo for / < 0 

[.4c”"®' sin «of for 0 ^ f < 00 

Plot the result for A = 10, wo = 27r X 10®, a = 2 X 10®. 

27. Find the Fourier transforms of the following functions: 


m 


(a) 


(b) 


/(O =0 for / < 0 
f{i) - at loxQ <t <ti 

fit) =ali- b(t - ti) for ti<t<tt'=‘h(l+f) 
fit) =0 for <2 < < < 00 
f /(<) =0 for < < <1 > 0 
fit) = for < / < fa 

fit) =0 for <2 < f < <» 


28. Let C(<o) = 2irg(«) and introduce Fit) =eir‘ X fit) ha. which ff is a real quantity. 
Then letting s — <r +joi, obtain from the Fourier transforms the Laplace transforms 


Fit) 


Gis) 


1 

Iwj J,-j 

x; 


G(5)c** ds 


F(t)e-*^ dt 


Show that the condition for the existence of the transform G{$) may be expressed by 
stating that the integral 


remains bounded 
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Thus show that if 1F(/)| < in which C and c are positive real constants, the 
transform G{s) exists so long as <r > c. (The quantity c is, therefore, caUed the abscissa 
of uniform convergence.) 

29. Find the abscissa of uniform convergence for the following functions 

i, i. i. .J—. _ L 1 1 

s' 5*’ 5"’ j+a’ 5-0* (s-ha)(s-b)' (s - a)^' 

1 1 g** 

(5 + a)(s — a)^ (VT + a)s \/j -j- a \/j ~ b ^ — o 

30. With the interpretation given in Prob. 28, and assuming F{t) =» 0 for ^ <0, 
show that the transforms of the following functions: 

a, g®*, sin at, cos at, sinh at, cosh at, g“®* sinh bt, 

g"^‘ cosh bt, t, t^, t sin at, i cos at (in which a and h 

are positive real constants) 

do exist; and by direct integration obtain for (/(r) respectively: 
a 1 g s a s b 

s' s^a* s^+a^' - a^' — (^-fg)* —6** 

s a 1 n\ las 5 * - g* 

(j+a)*-6*’ (i*+a*)*’ (j*+a*)* 

31 * Throu^i cx>ntour integration find F{t) corresponding to 

1 

- (s^a)is^b){s^c) 

in which a, b, c are real (imequal) quantities. Without further direct integration, 
what are the time functions corresponding to the following transforms: 

_£_^ ^^ _ 1 _ 

(5 ~ a)(s - b)(s — c)' (5 - g)(5 — b)(s — c)' s(s — a)(s — b)(s - c) 

32. Starting with the pair of transforms 

F(i) = G(s) = 

s — a 

find thnm^ convolution the time functions corresponding to 

1 1 1 _ 1 _ 

(s — o)*’ (f — a)(s — b) (5 — o)(r + 6) (r + <*)(* + J)('* + c) 

_ £1 _ 

(s+o)(*-i)(r-c) 
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Abel, 285 

Abridged quadratic form, 165 
Absolute convergence, 277 
circle, 283 
Adjoint, 42, 47 
Admittance function, 359 
Affine co-ordinates, 85 
scale of length in, 88 
transformation, 85 
Algebra, fundamental law of, 325 
Algebraic functions, 314, 318, 321 
singularities, 318 

Alternating component, of a periodic func¬ 
tion, 471 

Alternatives, rule of, 105 
Altitude function, 183, 195, 351 
Amplitude spectrum, 473 
Analytic continuation, 288, 549 
functions, 257 

Approximation, Bessel functions, 509, 568 
Fej6r polynomials, 496 
Fourier series, 483, 485 
Gibbs phenomenon, 495 
orthogonal functions, 442, 459, 501 
uniform tolerance for, 502 
Arc, differential, 198, 235 
Arithmetic mean sequence, 285 
Augmented matrix, 64 
Axes, principal, 137, 156, 159 
semi-, 140, 144 
co-ordinate (see Co-ordinates) 

Axial vector, 183 

B 

Beating, 513 

Bessel equation, 440, 562 
functions, 440, 506, 561 
approximation, 509, 568 
relation to Fourier series, 506 
Bierens de Haan, 345 
Bilinear form, 134 
transformation, 363 
Bipolar circle, 372 
Birkhoff, G., 142 
Bocher, M., 156 
Bode, H. W., 343, 346 


Bolzano-Weierstrass theorem, 276 
Bordered determinant, 11 
Borel, 285 

Boundary conditions, 207, 379, 440 
distributions, 441 
-value problems, 207, 379, 387 
Branch cut, 315 

integration across, 316, 560 
point, 296, 314 
definition, 314 

integration around, 310, 316, 560 
interpretation as a vortex, 351 
logarithmic, 319 

C 

Canonic form, matrix, 61 
quadratic form, 150, 154, 156, 159, 172 
Caratheodory, C., 1 

Cartesian co-ordinates, 85,100, 137, 159, 184, 
188, 235 

Casorati-Weierstrass, theorem of, 296 
Cauchy integral formula, 272 
integral law, 267 

principal value of an integral, 339 
principle of convergence, 277, 466 
residue theorem, 302 
-Riemann equations, 256 
theorem on the number of zeros In a region, 
407 

Cay ley-Hamilton theorem, 118 
Central conics, 135 
Cesaro sum of a series, 285, 496 
Chain, dipole, 358 

Characteristic determinant. 111, 141, 162 
equation of a matrix, 62, 111 
function of a matrix. 111 
matrix. 111, 141 

values of a matrix (see Latent roots) 
Charge density, 204, 291, 349 
Checkerboard rule, in determinants, 7 
Christoff cl, 378 
Circle, bipolar, 372 
convergence, 283, 288 
transformation of, by fractional transfoi- 
mation, 366 

unit, 284, 361, 369, 417, 419 
Cluster point, 276 
Cofactor, definition, 6 
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Cofactor, minor, 6 

relation to direction cosines, 112, 162 
use in inverting a matrix, 41 
use in solving equations, 13 
Coliineation, 117 {see also Linear transfor¬ 
mation) 

Collineatory transformation, 117, 137 
effect on latent roots, 118 
Column matrix, 32 
Comparison test, for series, 279 
Complex integration (see Integration) 
plane, 253, 258, 262 
simple, 365 
sphere, 262, 317, 376 
variables, 253 
conjugate value, 257 
definition, 253 

functions of (see Functions of a complex 
variable) 

polar representation, 253 
Condensation, point of, 276 
Condenser, 387 
Conditional convergence, 281 
Conditioned maxima, method of, 143, 211 
Conformal mapping, 258, 326, 330, 360, 378 
algebraic function, 315, 318 
at a zero or saddle point, 300 
circle, 363 

complex sphere, 263 
general function, 380 
inverse function, 326 
inversion, 331, 361 
linear fractional function, 363 
logarithm function, 310, 325 
polygon, 383 

polynomial functions, 397 
reciprocal function, 360 
reflection, 361 

Schwarz-Christoffel transformation, 378 
use of exponential function, 379, 391 
Congruent transformation, 136, 149, 157 
Conics, 135 

Conjugate diameters of an ellipse, 160 
matrix, 43 

potential functions, 333, 351 
Constraint, plane, 165 
vector, 166 

Constraints, linear, on a quadratic form, 165, 
\ 172 

, \Jontinuant, 21 

Vtiouation, analytic, 288, 549 
\tinued fraction expansion, 403 


Contour integration, 199, 204, 223, 264, 268, 
548 

functions of a complex variable (see 
Integration) 

functions of a real variable, evaluation, 
432, 548 
lines, 196 
map, 196 

Contragredient sets of variables, 95 
Contravariant components of a vector, 95, 
159 

Convergence, series (see Series, convergence) 
uniform, 282, 465, 500 
abscissa of, 575 
Convolution, 530 
Co-ordinates, affine, 85 
scale of length in, 88 

Cartesian, 85, 100, 137, 159, 184, 188, 235 
cylindrical, 234, 238 
general, 28, 234, 439 
normal, 111 

orthogonal, 81, 85, 97, 137, 140, 165, 184, 
234, (see also Co-ordinates, Car¬ 
tesian) 
reciprocal, 90 

rectangular (see Co-ordinates, Cartesian) 
right- and left-hand, 84, 184 
spherical polar, 234, 239 
transformation of, effect on latent roots, 
118 

effect on quadratic form, 135, 165 
oblique systems, 85, 97 
orthogonal systems, 81, 166, 184, 234 
Copson, E. T., 562, 569 
Couple, 543 

Courant, R., 142, 562, 569 

Covariant components of a vector, 95 

Cramer^s rule, 15 

Critical points, 382 

Cross product, 190 

Grout, P. D., 64 

Curl, in curvilinear co-ordinates, 243 
definition, 208 
deter mi nan tal form, 213 
divergence of, 218 
of the gradientf 213 

interpretation as a linear vector trans¬ 
formation, 228 
surface, 217 
of the vector r, 234 
Curvilinear co-ordinates, 89, 234 
curl in, 243 
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Curvilinear co-ordinateS) divergence in, 242 
gradient in, 240 

Cylinder functions, 440, 507, 562 
Cylindrical co-ordinates, 234, 238 

D 

d’Alembert ratio test, 278 
Dcdekind test for convergence, 282 
Definiteness of quadratic forms, 144,149,150, 
164, 171 

Degeneracy {see also Nullity, Rank) 
matrix, 61, 105, 109, 137 
degree of, 61 
quadratic form, 137 
Del, 197 

Dependence, linear, algebraic equations, 18, 
100 

vector fields, 186 
vector set, 77, 100, 114, 143 
Derivative, directional, 196 
of a function of a complex variable (see 
Functions of a complex variable, 
derivative) 
normal, 196 

of the singularity functions, 542, 546 
Determinant, bordered, 11 
characteristic. 111, 141, 162 
checkerboard rule, 7 
cofactor, 6, 40, 112, 162 
Cramer's rule, 15 
definition, 1 
development of, 7 
evaluation, 3, 9 
fundamental properties, 1 
Gramian, 146, 151 
Laplace's development, 7 
of a matrix, 31, 40, 137 
minor, 4, 19, 56 
principal, 5, 154, 406 
multiplication, 11 
order, 1 
product, II 
rank, 18, 39, 61, 78 
symmetrical, 15 
triangular form, 7 

use, in solving linear equations, 13 
Wronskian, 25 

Determinantal form, curl, 213 
Hurwitz criterion for polynomials, 405 
scalar triple product, 194 
vector product, 192 


Detour, semicircular, in contour integration. 
382, 549, 552, 560 

Diagonal form, reduction of a matrix to, 59, 
111, 137, 146, 152 

relation to quadratic form, 137, 143 
Dickson, L. E., 119 
Differential arc, 198, 235 
equations, Bessel’s, 440 
Cauchy-Riemann, 256 
Laplace’s, 207, 243, 266, 378, 439 
Legendre’s, 440 
Poisson’s, 207 
solution, 441 
wave, 440 
rectangle, 212, 269 
vector, 198, 201, 235 
volume, 202, 209, 241 

Differentiation, functions of a complex vari¬ 
able, 2S4, 275 
of a power series, 284 
of a vector, 225, 232 
Dipole, 216, 353 
chain, 353 
moment, 353 

Direction cosines, 82, 101, 112, 162 
parameters, 126 
Directional derivative, 196 
Dirichlet conditions, 463, 511, 520, 527 
Discriminant, 132, 137, 146, 154 
Distribution, boundary, 441 
initial, 441 
source, 200, 206, 291 
Divergence, 200, 228, 264 
of the curl, 218 

in curvilinear co-ordinates, 242 
definition, 201 
of the gradient, 206, 220 
surface, 206 
of the vector r, 233 
Dominant series, 279 
Dot product, 188 
Double stratum, 357 
Doublet, 353 
unit, 542, 546 

E 

Effective value, 478 
Fourier transform of, 530 
Eigenwerte, 140 (see also Latent roots) 
Electric charge density, 204, 291, 349 
field, 184, 349, 387 
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Electric charge density, field, intensity, 349 
networks, 158, 346, 359, 410, 416, 477, 481 
transmission line, 441, 452, 555 
Elementary functions, differentiability, 257 
transformation matrix, 54, 146 
Ellipsoidal surface, 138, 144, 149, 156, 165 
Elliptic transformation, 368 
Energy functions, 156, 184 
potential, 200, 222 
Entire functions, 297, 321 
Envelope functions, 515 
Equations, characteristic, of matrices, 62, 111 
differential, Bessel’s, 440, 562 
Cauchy-Riemann, 256 
Laplace’s, 207, 243, 266, 378, 439 
Legendre’s, 440 
Poisson’s, 207 
solution, 441 
wave, 440 

linear {see Linear algebraic equations) 
Error, 483, 502 
function, 544 

Essential singularities, 296 
Euler, 285 

Even functions, 340, 341, 398, 412, 450 
harmonics, 454 
Expansion {see also Series) 
continued fraction, 403 
of functions in series, 286, 290, 305, 307, 
415, 441 
orthogonal, 442 
partial fraction, 307, 415 
Exponential functions, in conformal map* 
ping, 379, 391 
Fourier series, 460, 531 
orthogonality, 444 
singularities, 296 

F 

Fej6r polynomials, 496 
relation to Fourier scries, 497 
uniform convergence of, 500 
Field, electric, 184, 349, 387 
force, 183, 200 
lamellar, 185 
map, 387, 391 

potential, 185, 200, 218, 221, 231, 234, 263, 
333, 351 
scalar, 183 
source, 185 

source-free, 185, 207, 218, 265 


Field, vector (see Vector field) 
vortex, 186 

Filamental source distribution, 204 
Fischer-Hinnen method, 570 
Flow lines, 184, 267 

source of, 185, 203, 388, 392 
map, 185, 388 
Flux density, magnetic, 349 
Force field, 183, 200 
gravitational, 200 
vector, 198, 208 
work due to, 198 
Formula, Cauchy’s integral, 272 
Schwarz-Christoffcl, 380 
summation, 479 
Fourier analysis, 501, 519 
graphical, 501 
integral, 517 

alternative forms, 522, 523 
derivation from Fourier series, 518, 
537 

elementary properties, 524 
Gibbs phenomenon, 522 
series, alternating component, 471 
approximation with, 483, 485, 501 
coefficients, 449, 460, 472 
complex, 460, 472 
convergence, 459, 464 
cosine, 450 
definition, 448 

Dirichlet conditions, 463, 511, 520, 527 
for even function, 450 
exponential form, 460 
fundamental period, 452 
Gibbs phenomenon, 495 
harmonics, 453, 454, 503 
least-squares property, 483 
for odd function, 450 
product of, 477 
rectangular wave, 470, 475 
relation to Bessel functions, 506 
relation to Fejer polynomials, 497 
relation to Fourier integral, 518, 537 
relation to Laurent series, 459 
saw-tooth wave, 456, 464 
sine, 450 
summation, 479 
triangluar wave, 471 
in two variables, 511 
value at a discontinuity, 464, 485, 500 
spectrum, 473 
synthesis, 519 
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Fourier transform, inverse, 473, 519 
of a product, 528 

Fractional function Linear fractional 
transformation) 

Frequency, 410, 452, 523 
domain, 472, 519 
groups, 512 

spectrum, 473, 514, 517 
Functions, altitude, 183, 195, 351 
Bessel, 440, 506, 561 
characteristic, 111 

complex variables (see Complex variables) 

conjugate potential, 333, 351 

cylinder, 440, 507, 562 

energy, 156, 184 

envelope, 515 

error, 544 

even, 340, 341, 398, 412, 450 
expansions in series, 286, 290, 305,307,415 
ex^jonential, time, 531 
fractional (see Linear fractional trans¬ 
formation) 

Hankel, 508 

mapping (see Conformal mapping) 
Neumann, 564 
odd, 340, 341, 398, 412, 450 
orthogonal, 442, 459, 501 
orthonormal, 442 

periodic, 452, 477, (see also Fourier series) 

permanence of form of, 290 

positive real (see Positive real functions) 

potential (see Potential function) 

f)roper, 439, 440 

pseudoscalar, 184 

pulse, 474, 494, 499, 521, 536 

real variable, integration of, 432 

scanning, 488, 498 

sequence of, 285 

singularity, 531, 544, 553 

spectrum representation, 473, 519 

transient, 517 

trigonometric, 439 

vector (see Vector function) 

Functions of a complex variable, algebraic, 
341, 318, 321 
analytic, 257 
branches, 318 
classification, 295, 317 
continuity, 258 
definition, 254, 256 
derivative, continuity, 257 
existence of, 257, 275 


Functions of a complex variable, derivative, 
order, 275 
unir]ueness, 255 

differential condition equations, 256 
differentiation, 254, 275 
entire, 297, 321 

graphical representation, 253, 258, 267 
holomorphic, 257 
identity theorem, 290 
impedance, 359, 410, 416 
integral, 297, 548 
integration (see Integration) 
inverse, 260, 321, 326 
logarithm, 310, 313, 325 
mapping, conformal (see Conformal map- 
pins) 

isogonal, 259 

maximum and minimum values in a region, 
328, 334 

maximum modulus, principle of, 328, 334, 
417 

mermorphic, 297, 321 
multivalued, 261, 289, 296, 310,1317, 321, 
326 

natural boundary, 288 

positive real (see Positive real functions) 

rational, 297, 307, 321, 359, 398, 410 

reciprocal, 305, 315, 360 

regular, 257 

relation between real and imaginary parts 
of, 256, 333, 339, 351 
schlict, 365 

singularities, algebraic, 318 
branch points, 315, 319 
definition, 257 

effect on convergence of Taylor's series, 
287, 288 
essential, 296 
infinitely dense, 288, 291 
integration around, 290, 304 
interpretation as vortexes, 265, 351 
isolated, 291 
logarithmic, 296, 345 
poles, 296, 323 
residue at, 304 

series expansions about, 290, 319 
types, 295 

transcendental, 297, 321 
uniqueness, 290 
uniqueness theorem, 290 
Fundamental component of a periodic func¬ 
tion, 453 
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Fundamental law of algebra, 325 
metric tensor, 92, 151 
period, 452 

properties of determinants, 1 
G 

Gaussian plane, 253 
Gauss’s law, 203, 217, 264 
Gibbs notation for vectors, 188, 190 
phenomenon, 495, 522, 535 
Gradient, 183, 195, 226 
curl of, 213 

in curvilinear co-ordinates, 240 
definition, 196 
divergence of, 206, 220 
notation, 197 
operator, 226, 230, 232 
of a scalar product, 230 
of the vector r, 233 
Gramian determinant, 146, 151 
Gravitational force, 200 

H 

Hamiltonian operator, 197, 203, 214 
Hankel functions, 508, 563, 568 
Harmonics, amplitudes, 453, 502 
analysis, 501 
even, 454 
odd, 454 

phase angles of, 453, 462, 526 
spherical, 440 

Heaviside Operational Calculus, 541 
Hilbert, D., 142, 562, 569 
transforms, 339 

application to network theory, 346 
degenerate forms, 343 
Holder, 285 

Holomorphic functions, 257 
Homographic transformation, 364 
Hurwitz criteria, 395 
polynomial, definition, 395 
even and odd parts, 398, 412 
importance in positive real functions, 411 
properties, 397, 399, 401 
test for Hurwitz character, 401, 403 
determinantal form, 405 
zeros, 395 

Hydrodynamic analogy, 184, 201, 204, 208, 
216, 263,303,388 
H3^rbolic transformation, 367 


I 

Identity matrix, 38 
theorem, 290 
Image, 331, 361 

Impedance function, 359, 410, 416, 481 
Impulse, unit, 539 

Independence, linear, algebraic equations, 
18, 100 

vector fields, 186 
vector set, 77, 100, 114, 143 
Inertia, law of, 148 
Infinite series {see Series, infinite) 

Infinity, point at, 262 
integration around, 307, 549 
vertex of polygon at, 384 
Initial conditions, 441 
Inner product, 188 
Integrability, 463 

Integral, Cauchy principal value of, 339 
formula, Cauchy’s, 272 
I'ourier, 517, 548 

derivation from Fourier series, 518 
functions, 297 
Laplace’s, 548 
law, Cauchy’s, 267 
line, 198, 267, 311 
Poisson’s, 330, 379 
sine-, 491, 501, 521, 534 
Sommerfeld, 507, 562 

Integration, contour, 199, 204, 223, 264, 268, 
548 

functions of a real variable, evaluation, 
432 

vector function, 199, 264 
functions of a complex variable, across a 
branch cut, 316, 560 
around a branch point, 310, 316, 560 
around the point at infinity, 307, 549 
around singularities, 290, 304, 382, 549, 
552, 560 

Cauchy’s integral formula, 272 
Cauchy’s integral law, 267, 548 
Cauchy’s cesidue theorem, 302 
independence of path, 268 
over a regular region, 267, 290 
power series, 284, 303 
saddle-point method, 565 
semicircular detour, 382, 549, 552, 560 
line, 198, 267, 311 
surface, 201, 204, 209, 215 
volume, 204, 230, 264 
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Inverse Fourier transform, 473, 519 
function of a complex variable, 260, 321; 
326 

linear transformation, 15, 39, 81 
matrix, 39, 44, 47, 57 
Inversion, graphical, 331, 361 
matrix, 41, 50, 63 
Irrotational field, 185 
Isogonal mapping, 259 
Iterated quadratic form, 155 

J 

7 -axis, 253 
Jacobian, 26, 237 

L 

Lagrange’s identity, 245 
Lagrangian multiplier, 143, 211 
Lamellar field, 185 

Laplace’s development of determinants, 7 
equation, 207, 243, 378, 439 
in Cartesian co-ordinates, 207 
in curvilinear co-ordinates, 243 
solution, 207 

in two dimensions, 266, 378 
integral, 548 
transform, 548 
Laplacian, 207, 220 
in curvilinear co-ordinates, 243 
operator, 206, 233 

Ivatent roots, associated with a positive defi¬ 
nite quadratic form, 149, 171 
associated with a quadratic form, 139, 149, 
157, 162, 171 
definition, 62 
distinctness of, 112, 141 
invariance with collineatory transforma¬ 
tion, 118 

of one matrix with respect to another 
matrix, 158, 162 
power of a matrix, 155 
relation to quadric surfaces, 139 
separation property of, 174 
symmetrical matrix, 121 
Laurent series (expansion), 290, 305, 319, 
324, 410, 459 
ascending part, 294 
convergence, 293 
descending part, 294 
integration of, 303 


Laurent series (expansion), near an algebraic 
singularity, 319 
principal part, 294, 308 
relation to Fourier series, 459 
relation to Taylor’s series, 290, 294 
Law of inertia, 148 

Least-squares approximation, 483, 501 
Left-handed co-ordinate system, 84, 184 
Legendre’s equation, 440 
Limit point, 276 
Line integral, 198, 267, 311 
spectrum, 473, 514 
transmission, 441, 452 

Linear algebraic equations {see also Linear 
transformation) 
equivalent set, 64 
homogeneous, 17 
independence, 18 100 
inverse set, 14, 39, 81 
solution, Cramer's rule, 15 
existence of, 16, 40, 100, 104, 115 
use of determinants, 13 
use of matrices, 39, 49, 63, (see also 
Matrix, inversion) 

Linear dependence and independence, of 
algebraic equations, 18, 100 
of vector fields, 186 
of a vector set, 77, 100, 114, 143 
Linear form, 133 

Linear fractional transformation, 363, 397, 
417 

fixed points of, 365 

interpretation on complex sphere, 376 
limitations of, 337, 365, 376 
pro}>crties of, 367, 373, 375 
of schlict functions, 365 
Linear transformation, 30, 76 (sec also Linear 
algebraic equations) 
affine, 85 

congruent, 136, 149, 157 
effect on fjuadratic form, 135 
inverse, 15, vS9, 81 
matrix of, 30, 54, 76, 136, 146, 157 
of a matrix, 54, 76, 136, 146, 149, 157, 
227 

orthogonal, 62, 81, 137, 156 
quadratic form of, 132, 151, 161 
vector significance of, 79, 186 
of vectors, 186, 227 

Logarithm, of a function of a complex vari¬ 
able, 310, 325 
principal value of, 313 
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Logarithmic branch point, 319 
singularity, 296, 345 

M 

M.I.T. Staff, 185, 207 
MacLane, S., 142 
Maclaurin’s series, 287, 330, 352 
Magnetic flux density, 349 
Map, contour, 196 
field, 387, 391 
flow, 185, 388 

Mapping, con formal (see Conformal mapping) 
function, 380 
isogonal, 259 
surfaces, 195 
Matrix, addition, 35 
adjoint, 42, 47 
augmented, 64 
canonical form, 61 
characteristic, 111, 141 
characteristic equation, 62, 111 
characteristic function, 111 
characteristic values, 62, 111 
column, 32 

conformability, 36, 49 
congruent transformation of, 136 
conjugate, 43 
definition, 30 

degenerate, 61, 105, 109, 137 
degree of degeneracy, 61 
determinant of, 31, 40, 137 
sign, 45, 84 
diagonal, 38, 42 
division by, 40 
Eigenwerte of, 140 
equality of, 32 
equivalence, 58 
identity, 38 
inverse, 39, 44, 47, 57 
inversion, 41, 50, 63 
latent roots (see Latent roots) 
of a linear transformation, 30, 54, 76, 136, 
140, 157 

modal, 116, 149, 155, 162 
multiplication, 31, 35 
nonsingular, 39 
null, 107 
nullity, 62, 109 
order, 31 

orthogonal, 45, 48, 57, 62, 84, 137, 148, 
166, 237, 442 


Matrix, partitioned, 48 
powers of, 120, 155 
Cayley-Hamilton theorem, 118 
product, 31, 35 
null, 107 

proper values, 140 
of a quadratic form, 132 
rank, 39, 43, 61, 105, 114, 159 
reciprocal, 45, 48 

reduction to diagonal form, 59, 111, 137, 
146, 152 

relation to quadratic form, 137, 143 
row, 31 
scalar, 38 
singular, 39, 47 
skew symmetrical, 39 
submatrices, 48 
symmetrical, 39, 115 
of tensors, 187 

transformation, 54, 76, 136, 146, 149, 157, 
227 

transpose, 43, 46 
triangular, 67, 152, 154 
unit, 38, 54 

use in solving linear equations, 39, 49, 
Maximum modulus, principle of, 328, 334, 
417 

Mean square value, 478, 483, 530 
Membrane, 441 

Mermorphic functions, 297, 321 
Minor, 4, 19, 59 (see also Cofactor) 
complement of, 5 
principal, 5, 154, 406 
Modal matrix, 116, 149, 155, 157, 162 
Modulation, 526 
Moment, dipole, 353 
vector, 126, 354 

Multiplicity of poles and zeros, 296, 298 
Multiply connected region, 221, 223, 271 
Multivalued functions, 221, 261, 289, 296, 
310,317, 321,326 
potential, 221 

Schwarz-Christoffel transformation, 382 
N 

n-dimensional space, 76, 90, 134, 167 
Natural boundary, 288, 422 
Network, lossless, 416, 555 
theory, 158, 346, 359, 410, 416, 477, 481 
Neumann functions, 564 
Nonturbulent field, 185, 187, 213, 265 
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Normal coordinates, 111 

derivative, 196 

form, of a quadratic form {stt Canonic 
form) 

Normalization of functions, 442 
of vectors, 89 
Null matrix, 107 
Nullity, 62 

Sylvester^s law of, 109 
O 

Oblique co-ordinates, 85, 97, 159 
Odd functions, 340, 341, 398, 412, 450 
harmonics, 454 

Operator, gradient, 226, 230, 232 
Hamiltonian, 197, 203, 214 
Laplacian, 206, 233, 439 
Order, determinant, 1 
matrix, 31 
tensor, 187 

Orthogonal circles, in linear fractional trans¬ 
formation, 366 

co-ordinates, 81,85,97,137,140, jl65, 184, 
234 (rce also Co-ordinates, Cartesian) 
expansions, 442 
families of curves, 267 
functions, 442 

linear transformation, 62 81, 137, 156 
matrix, 45, 48, 57, 62, 84, 137, 148, 166, 
237, 442 

polynomials, 442 

vectors, 81, 84, 107, 121, 168, 189, 190, 266 
vector sets, 81, 121, 168 
Orthogonality, conditions, 442 
exponential functions, 444 
trigonometric functions, 444 
Orthonormal functions, 442 

P 

p,r. function {see Positive real functions) 
Parallelepiped, curvilinear, 241 

volume, in terms of vector product, 194 
Parallelogram, area of, in terms of vectors, 
190 

law of addition, 188 
Partial fraction expansion, 307, 415 
Partitioned matrix, 48 
Periodic functions, 452 (see also Fourier series) 
jalternating component, 471 
beating, 513 


Periodic functions, effective value, 478 
harmonics, 453 
mean square value, 478 
product, 477 

Permanence of form of functions, 290 
Phase angle, harmonic^ of periodic function, 
453, 462, 526 
spectrum, 473 

Plane, complex, 253, 262, 268 
constraint, 165 
z-plane, 258 

Point, branch, 296, 314, 319, 351 
cluster, 276 
of condensation, 276 
fixed, 365 

at infinity, 262, 307, 384 
limit, 276 
saddle, 298, 321 
set, 276 
singular, 296 
source, 204 
of stagnation, 298 
stationary, 144, 172 
w'inding, 314 
Poisson^s equation, 207 
integrals, 330, 379 
Polar vector, 183 
Poles, 296, 323 
detection of, 326 
multiplicity, 296 

of a positive real function, 410, 414 
separation property, 400 
Polygon, mapping of, 383 
vertex angles, 385 

Polynomial, conformal mapping, 397 
differentiability, 257 
Fcjer, 496 

Hurwitz, 395, 401, 411 
orthogonal, 442 

in rational fractions, 308, 359, 398, 410 
trigonometric, 436 
Tschebyscheff, 431 
zeros of, 308, 324 

Positive definite quadratic form, 144, 150, 
164, 171 

latent roots of, 149, 171 
Positive real functions, definition, 409 
polar form of, 419 
poles and zeros, 410, 414 
properties, 411, 412, 417, 419 
relation to Hurwitz polynomials, 411 
residues, 411, 414 
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Potential energy, 200, 222 
field, 185, 200,218, 221, 231, 234, 263,333, 
351 

function, conjugate, 333, 351 
multivalued, 221 

scalar, 183, 195, 199, 206, 221, 439 
vector, 218, 263, 266 
theory, 330, 349, 439 
dynamic, 439 
Power, average, 478, 530 
factor, 478 
product, 477, 428 
series {se^ Series, power) 

Principal axes, 137, 156, 159 
minor, 154, 406 

part of Laurent series, 294, 308 
value of an integral, 339 
value of logarithm, 313 
Projection, stereographic, 262, 372 
Proper functions, 439, 440 
values of a matrix, 140 
values of wave equation, 441 
Pseudoscalar functions, 184 
Pulse functions, 474, 494, 499, 521, 536 
Fourier transform of, 474, 521, 536 

Q 

Quadratic form, 132 
abridged form, 165 

associated latent roots, 139,149,157,162, l7l 
associated linear transformation, 132, 151, 
161 

bilinear form, 134 

canonic form of, 150, 154, 156, 159, 172 
degeneracy, 137 

discriminant of, 132, 137, 146, 154 
effect of constraints upon, 165, 172 
effect of co-ordinate transformation upon, 
135, 165 

effect of linear transformation upon, 135 
geometrical interpretation, 134, 159, 165 
(see also Quadric surface) 
iterated, 155 
law of inertia, 148 
matrix of, 132 

normal form (see Canonic form) 
positive and negative definite, 144, 149, 
150, 164, 171 
rank, 133, 137, 146, 148 
reduction to sum of squares, more than 
two forms, 164 


Quadratic form, reduction to sum of squares, 
single form, 137, 146 
two forms, 156, 159 
signature, 148 

stationary points of, 144, 172 
Quadratic surface (see Quadric surface) 
Quadric surface, central, 135 
ellipsoidal, 138, 144, 149, 156, 165 
principal axes of, 137, 156, 159 
relation of latent roots to, 139 
semiaxes, 140, 144 

vector interpretation, 134, 137, 145, 159 
Quadripole, 354 

R 

r-vector, 231 
curl, 234 
divergence, 233 
gradient, 233 

Radius of convergence, 283 
Rank, determinant, 18, 39, 61, 78 
matrix, 39, 43, 61, 105, 114, 159 
quadratic form, 132, 137, 146, 148 
vector set, 78, 101 
Ratio test, 278 

Rational fraction, 308, 359, 398, 410 
functions, 297, 307, 321 
Reactance, 416 
Reciprocal co-ordinates, 90 
function, 305, 315, 360 
matrix, 45, 48 

Rectangular co-ordinates (see Cartesian co¬ 
ordinates) 

Reflection, 361 

Region of analyticity, 257, 288 
integration around, 268, 290 
multiply connected, 221, 223, 271 
simply connected, 221, 222, 271 
Regular function, 257 
Residue, definition, 304 
evaluation, 293, 302, 305, 308 
Cauchy^s theorem, 302 
in positive real functions, 411, 414 
Riemann, 256, 281, 507 
surfaces, 289, 310, 318 

visualization of, 315, 317, 321 
Right-handed co-ordinate system, 84, 184 
Ring, vortex, 216 
Root-mean-square value, 478 
Roots (see Zeros) 

Rotational field, 185 
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Rouch^’s theorem, 327 
Routh, 395, 407 
stability criteria, 395 
Row matrix, 31 
Rule of alternatives, 105 

S 

Saddle point, 298, 321 
conformal mapping near, 300 
method of integration, 565 
Saw-tooth wave, 456, 464 
Scalar field, 183 

potential function, 183, 195, 199, 206, 221 
product of vectors, 80, 122, 184, 188, 228, 
266 

gradient of, 230 
triple product, 193, 198 
Scanning function, 488, 498 
Schlicht functions, 365 
Schwarz-Christoffel formula, 380 
transformation, 378 
critical points, 382 
examples, 387 
multivaluedness, 382 
Schwarz^s lemma, 327 
Screw rule, 183, 188, 209, 211, 214, 217 
Semiaxes, 140, 144 

Semicircular detour, in contour integration, 
382, 549, 552, 560 

Separation property, of zeros and poles, 400 
Sequence, arithmetic mean, 285 
of functions, 285 
of points, 276 
Series, Ces4ro sum, 285 
convergence, absolute, 277 
Cauchy^s principle of, 277, 466 
circle, 283, 288 
comparison test, 279 
conditional, 281 
d'Alembert ratio test, 278 
Dedekind test, 282 
at a discontinuity, 464, 485, 500 
Fourier, 459, 464 
Laurent, 293 
Maclaurin, 287 
radius of, 283 
Taylor, 287, 288 
uniform, 283 
dominant, 279 

expansions of functions in, 286, 290, 305, 
307, 403, 415, 441 


Fourier, 448 
geometric, 436 
infinite, 276 

Laurent, 290, 305, 319, 324, 410, 459 
Maclaurin, 287, 330, 352 
power, 280, 283 

differentiation and integration, 284, 303 
expansions of functions in, 286, 290, 305 
summation, 479 
Taylor, 287, 305, 322, 323 
in two variables, 511 
Signature, 148 

Simply connected region, 221, 222, 271 
Sine-integral, 491, 501, 521, 534 
Singular matrix, 39, 47 
point, 296 

Singularities, algebraic, 318 
branch points, 315, 319 
definition, 257 

effect on convergence of Taylor's series, 
287, 288 
essential, 296 
exponential function, 296 
infinitely dense, 288, 291 
integration around, 290,304,382,548,552, 
560 

interpretation as vortexes, 265, 351 

isolated, 291 

logarithmic, 296, 345 

poles, 296, 323 

residue at, 304 

evaluation, 293, 302, 305, 308 
series expansions about, 290, 319 
types, 295 • 

Singularity functions, 531, 544, 553 
Sink, 185, 203, 388, 392 
Skew-symmetrical matrix, 39 
Solenoidal field, 185 
Sommerfeld, 507 
integral, 507, 562 
Source {see also Vortex) 
density, 215 

distribution, 200, 206, 291 
fiiamental, 204 
idealized, 204 
field, 185 

of flow lines, 185, 203, 388, 392 
point, 204 
voltage, 478 

Source-free field, 185, 207, 218, 265 
Spectrum, amplitude, 473 
continuous, 517 
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Spectrum, Fourier, 473 
frequency, 473, 514, 517 
line, 473, 514 
phase, 473 

Sphere, complex, 262, 317, 376 
Spherical harmonics, 440 
polar co-ordinates, 234, 239 
Square wave, 470 
Stability criteria, 395 
Stagnation, point of, 298 
Stationary point, 144, 172 
Step, unit, 533, 541, 545, 551 
Stereographic projection, 262, 317, 376 
Stieltjes continued fraction, 403 
Stokes’s law, 214, 223, 265, 270 
Stratum, double, 357 
Struik, D. J., 113 
Submatrices, 48 
Summation, CesiLro, 285, 496 
Fourier series, 479 

Surface, associated with quadratic form, 134 
constant-value, 195 
curl, 217 
divergence, 206 
integration, 201, 204, 209, 215 
mapping, 195 

quadric (see Quadric surface) 

Riemann, 289, 310, 318 
visualization of, 315, 317, 321 
of source distribution, 204 
Sylvester’s law of nullity, 109 
Symmetrical determinant, 15 
matrix, 39, 115 
latent roots of, 121 
transformation, 121, 133 

T 

Taylor’s series, 287, 305, 322, 323 
region of convergence, 287, 288 
relation to Laurent series, 290, 294 
Tensor, 92, 151, 187, 227 
components, 187 
fundamental metric, 92, 151 
matrix of, 187 
notation, 99 
order, 187 
valence, 187 
Thread, vortex, 216 
Time differentiation, 225, 439 
domain, 472, 519 
series (see Fourier series) 

Titchmarsh, E. C., 339, 340 


Torque, 183, 208 

Transcendental functions, 297, 321 
Transform, Fourier, 473, 519 
inverse, 473, 519 
Hilbert, 339 

application to circuit theory, 346 
degenerate forms, 343 
Laplace, 548 

Transformation, bilinear, 363 
collineatory, 117, 137 
congruent, 136, 149, 157 
co-ordinate (see Co-ordinates, transforma¬ 
tion of) 

elementary, of matrices, 54, 146 
elliptic, 368 

fractional (see Linear fractional trans¬ 
formation) 
group, 373 
homographic, 364 
hyperbolic, 367 

linear (see Linear transformation) 
matrix (see Linear transformation) 
orthogonal, 62, 81, 137, 140, 156, 166, 172, 
184, 234 

Schwarz-Christoffel, 378 
symmetrical, 121, 133 
vector, 186, 227 
Transient functions, 517 
convolution of, 530 
effective value of, 530 
mean value of, 530 
Transmission line, 441, 452, 555 
Transpose, of a matrix, 43, 46 
of a vector set, 77, 163 
Triangular form of determinant, 7 
matrix, 67, 152, 154 
wave, 471 

Trigonometric functions, 439 
orthogonality of, 444 
polynomial, 436 
series (see Fourier series) 

Triple product of vectors, scalar, 193, 198 
vector, 192 

Triplet, unit, 543, 546 
Tschebyscheff polynomials, 431 
Tube, 185, 230 

Turbulent field, 185, 186, 208, 215 
U 

Uniform convergence, 283 
abscissa of, 575 
Fejcr polynomials, 500 
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Uniform convergence, Fourier series, 465 
tolerance, 502 
Uniqueness theorem, 290 
Unit circle, 284, 361, 369, 417, 419 
doublet, 542, 546 
impulse, 539, 545 
matrix, 38, 54 
step, 533, 541, 545, 551 
triplet, 543, 546 
vectors, 85, 167, 217 
in curvilinear co-ordinates, 235 
in oblique co-ordinates, 87 
scalar product of, 189 
vector product of, 192 

V 

Valence of a tensor, 187 
Variables, complex (see Complex variables) 
functions of (see Functions of a complex 
variable) 

contragredient, 95 
Vector analysis, 183 
axial, 183 
constraint, 166 

contra variant and covariant components, 
95, 159 

curl, 208, 213, 217, 229, 234, 243 
definition, 183 
del, 197 

derivative, 225, 232 
differential, 198, 201, 235 
differentiation, 225, 232 
direction cosines, 82, 101, 112, 162 
direction parameters, 126 
divergence, 200, 206, 228, 233, 242, 264 
field, irrotational, 185 
lamellar, 185 

nonturbulent, 185, 187, 213, 265 
potential, 185, 200, 218, 234, 263 
rotational, 185 
solenoidal, 185 

source-free, 185, 207, 218, 265 
turbulent, 185, 186, 208, 215 
force, 198, 208 
function, 218, 228, 263 
linear, 228 

potential, 218, 263, 266 
Gausses law, 203, 217, 264 
Gibbs notation, 188, 190 
Hamiltonian operator, 197, 203, 214 
interpretation of a complex number, 253 


Vector interpretatoin of a linear transforma¬ 
tion, 79, 186, 227 

of a quadric surface, 134, 137, 145, 159 
moment, 126, 354 
normalization of, 89 

orthogonal, 81, 84,107, 121, 168, 189, 190, 
266 
polar, 183 

product of vectors, cross, 190 
determinantal form of, 192, 194 
dot, 188 
inner, 188 

scalar, 80, 122, 184, 188, 228, 266 
scalar triple, 193, 198 
triple vector, 192 
vector, 184, 190, 228 
r,231 

set, associated with quadric surface, 134, 
137, 145, 159 
inconsistent, 104 

linearly dependent, 77, 100, 114, 143 
linearly independent, 77, 145 
orthogonal, 81, 121, 168 
rank, 78, 101 
transposed, 77, 163 
Stokes’s law, 214, 223, 265, 270 
time-varying, 225 
unit, 85, 167, 217 
in curvilinear co-ordinates, 235 
in oblique co-ordinates, 87 
length, 88 
scalar product, 189 
vector product, 192 
useful relations, 228, 231 
use of vectors in interpreting linear equa¬ 
tions, 79, 100, 132 
Versors, 127 

Vertex angles of a polygon, 385 
Vortex, definition, 186 
density, 208, 215, 221 
distribution, 215, 219, 291 
field, 186 

representation by a singularity, 265, 
351 

ring, 216 
thread, 216 

W 

w-plane, 258 
Wave equation, 440 

proper values of, 441 
motion, 439 
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Weber, S07 
Winding point, 314 

Work, evaluation of, by line integral, 198,208 
Wronskian, 25 

Z 

a-plane, 258 

associated complex sphere, 262 


Zeros, 297, 298, 323, 395 
conformal mapping near, 300 
detection of, 325, 408 
of a Hurwitz polynomial, 395 
multiplicity of, 298 
of a polynomial, 308, 324, 395 
of a positive real function, 411, 414 
separation property of, 400 





